Skip navigation

Standard Performance Evaluation Corporation

Facebook logo LinkedIn logo Twitter logo Google+ logo
 
 

SERT 2

The SERT suite is providing a first order of approximation of server efficiency across a broad range of application environments. It is designed to be economical and easier to use by utilizing a comprehensive graphical user interface (GUI) and predetermined sets of tuning parameters. The SERT suite has been implemented and tested for a variety of 64-bit processors, operating systems, and JVMs. It is scalable and tested up to a maximum of 8 processor sockets and a maximum of 64 nodes. The server under test (SUT) may be a single stand-alone server or a multi-node set of servers. A multi-node SUT will consist of server nodes that cannot run independently of shared infrastructure such as a backplane, power-supplies, fans, or other elements. These shared infrastructure systems are commonly known as blade servers or multi-node servers.

The main body of code is in written in Java in order to lower the burden of cross-platform support. The framework is designed to accommodate other program languages as well. A series of different workload characteristics are implemented to demonstrate the effectiveness of different server sizes and configurations. The workload also utilized SPECís concept of multiple load levels and details can be found in the design document. Regulatory programs are designed to foster continuous improvement, with thresholds for success rising as the industry progresses. The SERT suite is designed to match this paradigm by implementing a quick adoption process of new computing technologies.

The right balance between high repeatability of the results, high sub-system coverage, and low resource allocation is desirable and resulted in a run time of around 2 Ĺ hours. The results output, including the SERT suite metric, are generated in both machine- and human-readable forms, enabling automatic submission to government-sponsored certification programs as well as both summary and detail reports for use by potential customers.

SERT 1.1.1 is currently the latest version supported by the U.S. EPA ENERGY STAR for Enterprise Servers V2 program. SERT 2.0.1 is currently targeting their v3 program.

The SERT suite is available for purchase via the SPEC order form.


News:

March 1, 2018: Updated client-configurations.xml for the SERT suite versions V2.0 released
• Intel Xeon Windows Server 2016 support added
• AMD EPYC Windows Server 2016 support added


December 19th, 2017: Issue with SERT 2.0.0 Metric
Summary:
• SPEC SERT 2.0.0 had a defect that resulted in an error in the calculation of the final Metric (composite score). The weights for two workloads in the release did not match the weights published in the documentation.
• SPEC has corrected the issue and has released SERT 2.0.1.
• SPEC has created an email process for automatically converting SERT 2.0.0 results to SERT 2.0.1 results: SERT 2.0.0 to 2.0.1 Result Conversion
• The patch for SERT 2.0.0 to address this issue can be downloaded from the SERT 2 Update Page



Information on the Tool

SERT 2 Documentation
Technical and support documents, run and reporting rules, etc.

JVM Options Guide for 2.0
SERT 2.x User Guide 
SERT 2.x Simplified Chinese User Guide 
Run and Reporting Rules
Result File Field Descriptions 
SERT 2.x Metric 

Technical Design Documents:   
          Design Document
          PTDaemon Tool Design

Power and Performance Methodology
Accepted Measurement Devices

Support

Technical support requiring involvement of specialists is done by volunteers from our member institutions (see member list). Please do not send us any proprietary information in your queries. If you feel you cannot clearly ask your question without reference to proprietary information please clearly mark such communications and we will not involve our SERT suite specialists, but rather will answer your query only if SPEC's own staff SERT suite generalists are able to do so.

Support Forums for the SERT suite, Chauffeur WDK and PTDaemon
Power Measurement Setup Guide

SERT Component Update Process (Draft)

In the quickly evolving world of computer servers, software updates are needed to enable support for new hardware and software platforms, to address software bugs, or to enhance usability.

However, to accurately compare SERT results, consistency in elements which affect the measurement, is required. Additionally, when SERT is implemented, it is imperative that changes which affect result comparability are not introduced for the duration of a government regulatory program.

To accommodate these requirements, the following test plans (draft) have been developed to maintain comparability of measurement results while allowing updates.

SERT Component Update Process (draft)

Updates

December 19th, 2017: SERT 2.0.1 released

For details on the update process, visit the SERT 2 update page

Credits

SERT Credits