Skip navigation

Standard Performance Evaluation Corporation

Facebook logo LinkedIn logo Twitter logo Google+ logo
 
 

SERT 2.0.0 to SERT 2.0.1 Results Conversion Tool

Summary:

    • SPEC SERT 2.0.0 had a defect that resulted in an error in the calculation of the final Metric (composite score). The weights for two workloads in the release did not match the weights published in the documentation.
    • SPEC has corrected the issue and has released SPEC SERT 2.0.1.
    • SPEC has created an email process for automatically converting SPEC SERT 2.0.0 results to SPEC SERT 2.0.1 results.
    • The patch for SERT 2.0.0 to address this issue can be downloaded from the SERT 2 update page


Details:
Issue with SPEC SERT 2.0.0 Metric

With SPEC SERT 2.0.0, SPEC introduced a composite score that combined the scores of the individual workloads by applying a weight to each workload’s score. The different weights for the workloads are 65% for CPU, 30% for Memory, and 5% for Storage. In SPEC SERT 2.0.0, these weights were incorrectly implemented at 60%, 35%, and 5%, respectively.


Issue fixed in SPEC SERT 2.0.1 onwards

The issue has been fixed in SERT 2.0.1. The weights used for the different workloads have been updated and match the documented weights.


Process to convert valid SPEC SERT 2.0.0 results to valid SPEC SERT 2.0.1 results

SPEC realizes that our customers may have valid SPEC SERT 2.0.0 results which they obtained using SPEC SERT 2.0.0. We do not want our customers to repeat the tests that they have already run. To that end, we have created a conversion tool that automatically converts a valid SPEC SERT 2.0.0 result into a SPEC SERT 2.0.1 result.


The process to convert SPEC SERT 2.0.0 to SPEC SERT 2.0.1 is designed to be very straightforward, and involves the following steps:

  1. Email your existing valid SERT 2.0.0 results.xml file to subsert200updater@spec.org as an attachment. The attachment is required to be in either zip or tar.gz compression archive format (with the archive containing the .xml file) to reduce the size of the result file.
  2. SPEC will convert the supplied result to a SPEC SERT 2.0.1 result.
  3. The converted result file will be sent back to your email address as an attachment in zip file format.
    1. Only valid SPEC SERT 2.0.0 results are converted to SPEC SERT 2.0.1 results.
    2. If the result file that was sent in, was not a valid result from a SPEC SERT 2.0.0 version, the conversion tool will reject the conversion request, and an appropriate response is sent back via email to the submitter.
    3. The original result file that is emailed to subsert200updater@spec.org address, is stored in the SPEC database. The results are protected by the SPEC confidentiality rules, and are not accessible publicly.