SPEC
Retired Products

SPEC retires products either because we release a replacement or because the underlying technology becomes obsolete. However, even if we cannot continue to offer support, our retired products can be made available because we understand that some users will continue to have historical interest or perhaps may even continue to have ongoing testing requirements.

See Also:

Retired Products

All products below are all retired. This material is only available on an “as is” basis, and we are no longer able to provide any support.

SPEC Cloud IaaS 2016

[Retired] The SPEC Cloud IaaS 2016 benchmark was SPEC’s first benchmark suite to measure cloud performance. The benchmark addresses the performance of public or private infrastructure-as-a-service (IaaS) cloud platforms.

SPEC SFS 2014

[Retired] The SPEC SFS 2014 benchmark is the latest version of the Standard Performance Evaluation Corporation benchmark suite measuring file server throughput and response time, providing a standardized method for comparing performance across different vendor platforms.

SPECjbb2013

[Retired] The SPECjbb2013 benchmark has been developed from the ground up to measure performance based on the latest Java application features. It is relevant to all audiences who are interested in Java server performance, including JVM vendors, hardware developers, Java application developers, researchers and members of the academic community.

AndEBench

[Retired] A standardized, industry-approved method of evaluating Android-enabled devices.

SPEC SIP_Infrastructure 2011

[Retired] The SPEC SIP_Infrastructure 2011 benchmark is designed to evaluate a system’s ability to act as a SIP server supporting a particular SIP application. The application modeled is a VoIP deployment for an enterprise, telco, or service provider, where the SIP server performs proxying and registration.

SPECvirt_sc2010

[Retired] SPECvirt_sc2010 is SPEC’s first benchmark addressing performance evaluation of datacenter servers used in virtualized server consolidation, measures the end-to-end performance of all system components including the hardware, virtualization platform, and the virtualized guest operating system and application software.

SPECweb2009

[Retired] The SPECweb 2009 workloads include: Banking, which is a fully secure SSL-based workload; Ecommerce, which includes both SSL and non-SSL requests; and Support, which is a non-SSL workload that includes large downloads. New with SPECweb 2009 is the inclusion of a Power workload with a performance/power metric.

SPECmail2009

[Retired] The SPECmail2009 benchmark measures the ability of corporate e-mail systems to meet today’s demanding e-mail users over fast corporate local area networks (LAN). The SPECmail2009 benchmark simulates corporate mail server workloads that range from 250 to 10,000 or more users, using industry standard SMTP and IMAP4 protocols.

SPECmail2008

[Retired] SPECmail2008 is a software benchmark designed to measure a system’s ability to act as an enterprise mail server servicing email requests based on the Internet standard protocols SMTP and IMAP4. The benchmark concentrates on the workload encountered by corporate mail servers, with an overall user count in the range of 250-5,000 users.

SPEC SFS 2008

[Retired] The SPEC SFS 2008 benchmark is an updated version of the Standard Performance Evaluation Corporation benchmark suite measuring file server throughput and response time, providing a standardized method for comparing performance across different vendor platforms. The suite is a follow-on to the SFS97_R1 benchmark, adding a CIFS workload, an updated NFSv3 workload, support for additional client platforms, and a new test harness and reporting/submission framework.

SPEC JMS 2007
SPEC JMS® 2007 The SPEC JMS® 2007 benchmark is the first industry-standard benchmark for evaluating the performance of enterprise message-oriented middleware servers based on JMS (Java Message Service). It provides a standard workload and performance metrics for competitive product comparisons, as well as a framework for in-depth performance analysis of enterprise messaging platforms. The benchmark measures the end-to-end performance of all components that make up the application environment, including hardware, JMS server software, JVM software, database software if used for message persistence, and the system network.
SPEC CPU 2006

[Retired] The SPEC CPU 2006 benchmark package contains SPEC’s next-generation, industry-standardized, CPU intensive suites for measuring and comparing compute intensive performance, stressing a system’s processor, memory subsystem and compiler.

SPECweb 2005

[Retired] SPECweb 2005 is the next-generation SPEC benchmark for evaluating the performance of World Wide Web Servers, continuing the SPEC tradition of giving Web users the most objective and representative benchmark for measuring a system’s ability to act as a web server.

SPECjbb 2005

[Retired] SPECjbb 2005 (Java Server Benchmark) is SPEC’s benchmark for evaluating the performance of server side Java evaluating the performance of server side Java by emulating a three-tier client/server system (with emphasis on the middle tier).

SPECjAppServer2004

[Retired] SPECjAppServer2004 (Java Application Server) is a multi-tier benchmark for measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based application servers with an end-to-end application which exercises all major J2EE technologies implemented by compliant application servers.

SPEChpc 2002

[Retired] The SPEChpc 2002 benchmark is derived from real HPC applications and application practices, and measure the overall performance of high-end computer systems, including the computer’s processors (CPUs), the interconnection system (shared or distributed memory), the compilers, the MPI and/or OpenMP parallel library implementation, and the input/output system.

SPECjAppServer2002

[Retired] SPECjAppServer2002 (Java Application Server) is a client/server benchmark for measuring the performance of Java Enterprise Application Servers using a subset of J2EE APIs in a complete end-to-end web application. It is the same as SPECjAppServer2001 (released in September 2002) except that the Enterprise Java Beans (EJBs) are defined using the EJB 2.0 specification instead of the EJB 1.1 specification.

SPECjAppServer 2001

[Retired] The SPECjAppServer 2001 benchmark is a client/server benchmark for measuring the performance of Java Enterprise Application Servers using a subset of J2EE APIs in a complete end-to-end web application.

SPECweb 99 SSL

[Retired] SPECweb 99_SSL answers the need for a meaningful measure of the web server load generated by servicing encrypted requests, which have become more prevalent on the web over the last few years. SPECweb 99_SSL adopts an industry-accepted workload to measure the performance capabilities of a web server with added SSL encryption/decryption.

SPEC SFS97_R1 (3.0)

[Retired] SPEC SFS97_R1 V3.0 replaces SFS97 V2.0 resolving defects in SFS V2.0, and improving the interface and results generation tool, and continues to measure both NFSv2 and NFSv3, to support TCP or UDP, with an operation mix more closely matches today’s real-world NFS workloads.

SPEC OMP 2001

[Retired] The SPEC OMP benchmark suite is the first one for evaluating performance based on OpenMP applications. The benchmark continues the SPEC tradition of giving HPC users the most objective and representative benchmark suite for measuring the performance of SMP (shared memory multi-processor) systems.

SPECmail2001

[Retired] SPECmail2001 is a standardized mail server benchmark designed to measure a system’s ability to act as a mail server servicing email requests, based on the Internet standard protocols SMTP and POP3. The benchmark focuses on the ISP as opposed to Enterprise class of mail servers, with an overall user count in the range of approximately 10,000 to 1,000,000 users.

SPECjbb2000

[Retired] SPECjbb2000 (Java Business Benchmark) is SPEC’s first benchmark for evaluating the performance of server-side Java.

SPEC CPU2000

[Retired] SPEC95 comprises two sets (or suites) of benchmarks: CINT95 for compute-intensive integer performance and CFP95 for compute-intensive floating point performance. SPEC benchmarks are selected from existing application and benchmark source code running across multiple platforms.

SPECweb 99

[Retired] SPECweb 99 is the next-generation SPEC benchmark for evaluating the performance of World Wide Web Servers, continueing the SPEC tradition of giving Web users the most objective and representative benchmark for measuring a system’s ability to act as a web server.

SPEC JVM98

[Retired] SPECjvm98 evaluates performance for the combined hardware includes software aspects of the JVM client platform. On the software side, it measures the efficiency of JVM, the just-in-time (JIT) compiler, and operating system implementations. On the hardware side, it includes CPU (integer and floating-point), cache, memory, and other platform-specific performance.

SPEC SFS97 (2.0)

[Retired] SFS97, the replacement for the previous SFS benchmark formally known as LADDIS or SFS93, measures both NFSv2 and NFSv3, supports TCP or UDP, and the operation mix more closely matches today’s real-world NFS workloads.

SPEC HPC 96

[Retired] SPEC HPC 96 is a benchmark suite that measures the performance of high-end computing systems running industrial-style applications. The SPEChpc line of benchmarks is especially suited for evaluating the performance of parallel and distributed computer architectures.

SPECweb 96

[Retired] SPECweb 96 is a standardized benchmark for measuring basic Web Server performance. SPECweb 96 features: Standardized workload, agreed to by major players in WWW market; full disclosures available available on this web site; stable implementation with no incomparable versions.

SPEC CPU95

[Retired] SPEC95 comprises two sets (or suites) of benchmarks: CINT95 for compute-intensive integer performance and CFP95 for compute-intensive floating point performance. SPEC benchmarks are selected from existing application and benchmark source code running across multiple platforms.

SPEC SDM Suite

[Retired] The SPEC SDM Suite was designed to find out how a system handles an environment with a large number of users issuing typical software development commands: make, cp, diff, grep, man, mkdir, spell, etc…

SPECsfs93 (LADDIS)

[Retired] SPEC SFS introduces 097.LADDIS which is a re-implementation of the Nhfsstone workload that has been further enhanced by SPEC. This test subjects an NFS server to a large and varied request load from several client drivers.

SPEC CPU92

[Retired] SPEC CPU92 comprises two sets (or suites) of benchmarks: CINT92 for compute-intensive integer performance and CFP92 for compute-intensive floating point performance. SPEC benchmarks are selected from existing application and benchmark source code running across multiple platforms.

SPEC CPU89

[Retired] SPEC CPU89 has been considered obsolete since June 1993.