Standard Performance Evaluation Corporation
SPECjbb2005 (RETIRED: October 2013)
SPECjbb2005 (Java Server Benchmark) is SPEC's benchmark for evaluating the performance of server side Java. Like its predecessor, SPECjbb2000, SPECjbb2005 evaluates the performance of server side Java by emulating a three-tier client/server system (with emphasis on the middle tier). The benchmark exercises the implementations of the JVM (Java Virtual Machine), JIT (Just-In-Time) compiler, garbage collection, threads and some aspects of the operating system. It also measures the performance of CPUs, caches, memory hierarchy and the scalability of shared memory processors (SMPs). SPECjbb2005 provides a new enhanced workload, implemented in a more object-oriented manner to reflect how real-world applications are designed and introduces new features such as XML processing and BigDecimal computations to make the benchmark a more realistic reflection of today's applications.
SPECjbb2005 was retired on October 1, 2013 in favor of its successor, SPECjbb2013. As of October 1, no further submissions are being accepted and technical support is no longer provided.
SPECjbb2005 allows rule-compliant results to be published independently. Although SPEC will not publish new results, it is possible that others might choose to do so. Any such publication must plainly disclose that SPECjbb2005 has been retired. See http://www.spec.org/fairuse.html#Retired for more information.
Note: The restriction of compliance in section 4.1 of the SPECjbb2005 run rules specifically related to setting the input.expected_peak_warehouse property is removed for independent results in retirement.
SPECjbb2005 Benchmark Highlights
The current version of the benchmark is version 1.07. Updates since the initial release include changing the metric name from "bops" to "SPECjbb2005 bops", changes to correct a dependency on the Sun implementation of HashMap in the benchmark code, and updates to the benchmark tools and documentation. The most recent versions of the benchmark documentation are posted below.
Future Benchmark Workload Development, Call For Participation:
If you're a developer of an EJB server, this is your opportunity to help shape the standardized testing of your competitors! Contact SPEC at firstname.lastname@example.org