Skip navigation

Standard Performance Evaluation Corporation

 
 

Submitting OSG Benchmark Results

Why submit results to SPEC?

SPEC's mission is to develop benchmarking standards and the corresponding software tools for fairly evaluating modern computer performance, and to provide an open forum for the results. SPEC invites you to help populate its public database of benchmark results. Licensees of the SPEC benchmarks may run the tests and submit results to SPEC. SPEC reviews the results and publishes them on its website for a processing fee. Having more results published on the SPEC website means having more information available to the community to make better comparisons. Help us level the playing-field; submit your results to SPEC.

Who may submit results and how much does it cost?

Any individual or group licensed with SPEC software (see our online product order form) may submit results to SPEC. There is a US$500 publication fee for each result submitted to SPEC, except in the case of a SPECjAppServer, SPECjms2007, or SPECsfs2008 result submission where the fee is US$1000. Payment is expected prior to publication of a reviewed result. SPEC members and associates may submit an unlimited number of results for no charge, one of the many benefits afforded by membership to SPEC. If you expect that you will be submitting more than 12 results in a one year period of time, you should consider joining SPEC as a member or associate. For more info on SPEC membership, contact us!

How to submit results?

Results are submitted to SPEC via email. Results may be submitted at any time on any day of the week (but they are reviewed and published on a specific schedule). Each benchmark result undergoes a two (2) week review/publication cycle according to the following calendar.

In general, the result or raw result file should be submitted to SPEC as an attachment to an email to the appropriate benchmark submission drop. For a list of result submission email drops please send mail to info@spec.org.

Additional and specific information on submitting results can be found in each benchmark's run and reporting rules and user guide documentation.

More info?

To better understand the SPEC result review process, please consult the SPEC/OSG Policy Document, Section: Guidelines for Result Submission and Review.

SPEC is accepting results from the following benchmarks/versions:

Benchmarks Versions Accepted
SPEC CPU2006 1.2
SPECjbb2013 1.00
SPECjEnterprise2010 1.03
SPECjms2007 1.0
SPECjvm2008 1.0
SPECpower_ssj2008 1.12
SPECsfs2008 1.00
SPECsip_Infrastructure2011 1.00
SPECvirt_sc2013 1.0