SPEC Workstation Benchmark
SPEC/GWPG (Graphics & Workstation Performance Group) is an umbrella organization for autonomous project groups that develop graphics and workstation benchmarks and performance reporting procedures. The group supports the development of a range of graphics and workstation benchmarks that have a value to the user and vendor communities and is always looking for new groups that realize the value of working under the SPEC/GWPG charter. To this end, SPEC/GWPG is building a workstation benchmark that represents the performance characteristics of workstation applications, without requiring the full application and associated licensing to be installed on the system under test.
What is SPEC/GWPG Looking For?
In keeping with the SPEC/GWPG philosophy of characterizing performance of workstations running applications, not synthetic workloads, the group is looking for applications, algorithms, and workloads that are representative of those used by typical workstations customers in CAD/CAE, digital media and entertainment, finance, health sciences, energy and other prominent markets. The SPEC/GWPG group has established the following goals to define performance:
- To permit standardized performance measurement and evaluation by creating unambiguous, vendor-neutral measures for product evaluation and comparison.
- To contribute to the coherence of the field of performance measurement and evaluation so that vendors will be better able to present well-defined measures and customers will be better able to compare and evaluate vendors' products and environments.
- To provide mechanisms that enable vendors, customers and others to perform their own performance measurements and evaluations.
- To provide software releases to the public in a timely fashion.
Criteria for selecting tests for the Workstation Benchmark Suite
- Application or algorithm must be used by real users, or derived from a representative application from the desktop workstation market.
- Workload generated from the models must be typical for the software with respect to memory usage, scalability with number of cores and core frequencies.
- Capable of solving problems or varying sizes with an emphasis on large (>10GB) problems.
- Generate reproducible results.
- Portable to multiple hardware architectures.
- Can be compiled with the Microsoft Visual C++ compiler.
Benefits of supplying application code for the SPEC Workstation Benchmark
- The code will become the target for hardware vendors’ optimizations that will likely speed performance for the real-world application.
- The application will receive worldwide media coverage through SPEC press releases and as part of a benchmark that will be used widely for product reviews in online and print publications.
- ISVs will garner goodwill from customers who will be able to use the benchmark for workstation performance evaluation based on their actual application.
- The application will receive high-profile exposure on the SPEC website, visited by nearly one million annually.
- The application will receive direct exposure from the thousands expected to download the benchmark
How to Participate