Standard Performance Evaluation Corporation
SPEC: For 30 years, a beacon of truth
"There are lies, damned lies, and benchmarks."
The above line, derived from a Mark Twain quote about statistics, used to be a common perception among computer technologists. But, you don't hear it much, if at all, anymore. That's a testament primarily to one organization: The Standard Performance Evaluation Corporation (SPEC®).
With 125 members in 22 countries and nearly two dozen benchmarks spanning highly diverse aspects of computing performance and energy efficiency, SPEC has become known as a beacon of truth for computing researchers, vendors, users and analysts worldwide. These professionals rely on SPEC to ensure that the marketplace has a fair and useful set of metrics to differentiate computing systems.
John Mashey discusses foxes, hen houses and the founding of SPEC (video).
To mark its 30th anniversary, SPEC has assembled a 30-year historical timeline and overviews of its four major groups, its energy initiatives, and its headquarters operations, with quotes from observers and participants over those three decades. Long live better benchmarks!