Skip navigation

Standard Performance Evaluation Corporation

 
 

The Standard Performance Evaluation Corporation (SPEC) is a non-profit corporation formed to establish, maintain and endorse standardized benchmarks and tools to evaluate performance and energy efficiency for the newest generation of computing systems. SPEC develops benchmark suites and also reviews and publishes submitted results from our member organizations and other benchmark licensees.

What's New:

05/23/2017: SPEC's Research Group has issued a call for nominations for the Kaivalya Dixit Distinguished Dissertation Award recognizing outstanding doctoral dissertations in the field of computer benchmarking, performance evaluation, and experimental system analysis. The award is open to dissertations that have been defended between October 2016 and September 2017.

05/22/2017: In an exclusive interview, Klaus-Dieter Lange, SPECpower chair, discusses the origin of SERT, the challenges of creating an international standard, the prospect of continued improvements in server efficiency, and his own personal growth in leading a diverse group of technologists.

05/22/2017: SPEC's High-Performance Group (SPEC/HPG) is offering rewards of up to $5,000 and a free benchmark license for application code and datasets accepted under its new SPEC MPI Accelerator Benchmark Search Program. Applications that make it through the entire search program will be incorporated into a new benchmark currently called SPEC MPI ACCEL. The new benchmark will combine components of the current SPEC MPI and SPEC ACCEL benchmark suites.

04/18/2017: Version 2.0 of the Chauffeur Workload Development Kit (WDK) has been released. This major release is based on the SERT 2.0 infrastructure and includes significant enhancements to the hardware detection, customization options of generating HTML reports, and developer documentation. It has now reduced memory requirements for the Director when signing results files and reduced the size of the result output for large systems or clusters. There is also an updated list of supported operating systems including Ubuntu (14.04 LTS and 16.04 LTS) as well as current versions of Windows Server, RHEL, SLES, AIX, and Solaris.

04/04/2017: A patch has been released for SPECvirt_sc2013 V1.1 which addresses an issue encountered when running the webserver workload with TLS encryptions which would cause any result to be marked as invalid. Any result submissions using TLSv1, TLSv1.1, or TLSv1.2 encryptions for the webserver workload must use this patch.

04/04/2017: Scott Beamer III from the University of California, Berkeley is the winner of the 2016 SPEC Kaivalya Dixit Distinguished Dissertation Award with his dissertation on the characterization and treatment of fundamental performance bottlenecks in graph processing and the contribution of the Graph Algorithm Platform (GAP) benchmark suite.

03/28/2017: SPEC announces the release of the Server Efficiency Rating Tool (SERT) 2.0, which adds a single-value metric, reduces runtime, improves automation and testing, and broadens device and platform support. Designed to be simple to configure and use via a comprehensive graphical user interface, the SERT suite uses a set of synthetic worklets to test discrete system components such as processors, memory and storage, providing detailed power consumption data at different load levels.

03/22/2017: Walter Bays steps down as SPEC president after presiding over 12 years of growth; he is succeeded by David Reiner, a SPEC 12-year veteran.

 

[Older items can be found in the archive.]