Skip navigation

Standard Performance Evaluation Corporation

Facebook logo LinkedIn logo Twitter logo Google+ logo
 
 

The SPECjbb®2015 benchmark has been developed from the ground up to measure performance based on the latest Java application features. It is relevant to all audiences who are interested in Java server performance, including JVM vendors, hardware developers, Java application developers, researchers and members of the academic community. The SPECjbb®2015 benchmark is available for purchase via the SPEC order form.


October 12, 2017: The SPECjbb®2015 benchmark V1.01 is now available. This update includes bug fixes and documentation updates to enable the benchmark to be used with Java SE 9. Specifically:

  • A bug fix for incorrect classes being used with running with Java SE 9.
  • FAQ and "Known Issues" documentation changes:
    • Options needed to run with Java SE 9.
    • A possible change in the automatically deetermined default values of a couple of properties (e.g. specjbb.forkjoin.works) is explained.

While Java SE 8 (and earlier) results using V1.01 remain comparable to V1.0 results, V1.0 will produce incorrect results when used with Java SE 9. This makes it important to move ahead to V1.01. After January 17, 2018 all result submissions must be made using V1.01 and V1.0 will be retired.

Licensees of version 1.0 are entitled to a complimentary V1.01 upgrade.


For a list of changes in the SPECjbb®2015 benchmark relative to the retired SPECjbb®2013 benchmark, please see the release notes.

Benchmark architecture diagram

Features include:

  • A usage model based on a world-wide supermarket company with an IT infrastructure that handles a mix of point-of-sale requests, online purchases and data-mining operations.
  • Both a pure throughput metric and a metric that measures critical throughput under service level agreements (SLAs) specifying response times ranging from 10ms to 100ms.
  • Support for multiple run configurations, enabling users to analyze and overcome bottlenecks at multiple layers of the system stack, including hardware, OS, JVM and application layers.
  • Exercising new Java 7 features and other important performance elements, including the latest data formats (XML), communication using compression, and messaging with security.
  • Support for virtualization and cloud environments.

Results

Submitted Results
Includes all of the results submitted to SPEC from licensees of the benchmark.

Information

Press Release
Benchmark Documentation

Issues building/running the benchmark
Installation, build, and runtime issues raised by users of the benchmark. (Last updated: September 14, 2017 V1.01)