Last updated: $Date: 2009-12-01 10:28:43 -0500 (Tue, 01 Dec 2009) $ by $Author: keeper $
(To check for possible updates to this document, please see http://www.spec.org/mpi2007/Docs/ )
Creating a suite of source code benchmarks to provide a consistent, comparative measure of MPI and CPU-intensive performance is not simple. The challenges are numerous, for example:
And in the end, you hope you have something that is fair, relevant, and understandable, that will address technology for a period of years.
Such is the case with SPEC MPI2007, which is a new benchmark. The new benchmark suite:
All of this is due to the efforts of a large team of people from around the world, that SPEC would like to thank (with apologies and thanks to those who may not be listed).
SPEC MPI benchmarks are based on real-world applications (rather than using loop kernels or artificial stress tests). We therefore thank the authors of those real-world applications.
Thank you to the many participants of the "SPEC MPI Benchmark Search Program" and, in particular, the authors that contributed programs that were made part of the suite:
|107.leslie3d||Christopher Stone and Suresh Menon|
|121.pop2||Los Alamos National Laboratory (LANL)|
|122.tachyon||John E. Stone|
|126.lammps||Sandia, Steve Plimpton|
|127.wrf2||See Open Source Credits below|
|130.socorro||Developed by a number of contributors from Sandia National Labs, Vanderbilt University, and Wake Forest University. Our main point of contact was Alan Tackett.|
|132.zeusmp2||John Hayes and Michael L. Norman|
|137.lu||See Open Source Credits below|
|142.dleslie||Christopher Stone and Suresh Menon|
|147.l2wrf2||See Open Source Credits below|
Thank you to the original authors of, and contributors to, open-source programs that were adapted by SPEC for inclusion in the suite. These programs include:
|127.wrf2||127.wrf2 is derived from 481.wrf which is based on the Weather Research and Forecasting (WRF) Model, which has
5 development teams and a cooperative effort spanning
multiple agencies, labs, and universities.
Also, 127.wrf2 uses NetCDF, which has many contributors.
|137.lu||based on the LU program from the NPB suite of benchmarks.|
For more information regarding the SPEC benchmarks, including information about other contributors, see the documentation in the individual benchmarks directories.
We would also like to thank:
SPEC management, who provided us with resources, and kept the SPEC HPG Subcommittee on their toes:
The SPEC office, who were the ones who really provided us with the resources:
Most importantly, thank you to the people who sweated through technical details and porting issues, debated their view points vigorously, and were willing to drive issues to conclusion. Without these people this benchmark suite would truly not exist.
A benchmark "Project Leader" serves as the focal point for porting a program to all the tested platforms, improves the stability of the code, removes code that SPEC does not want to test (such as platform-specific extensions), writes documentation, consults with both the author and the users, and generally tries to give each benchmark its best chance at making it through SPEC's testing process. Thank you to these project leaders:
In addition to the above, many other people from the member companies assisted with benchmark development, including but not limited to Matt Colgrove, Alexey Starovoytov, Joseph Robichaux, Alexander Isaev, Mark Debbage, Hakon Bugge, Asmund Ostvold, John Benninghoff, Gary Applegate, Joshua Mora.
Analysis of the candidate benchmarks was a substantial task. Contributors to profiling and other forms of analysis included: John Baron, Carl Ponder, Hideki Saito, Ron Lieberman, Kaivalya Dixit, Tom Elken, Chris Parrott, Brian Whitney, Matthijs VanWaveren, Mattias Mueller.
Cloyce Spradling is the primary author of the SPEC MPI2007 toolset.
Carl Ponder is the primary author of the documentation.
Finally, we thank all of the people behind the scenes in the compiler groups, architecture groups and performance groups who supported their work for SPEC at their respective companies.
Brian Whitney, Release Manager, SPEC MPI2007
Mattias Mueller, Vice-Chair, SPEC HPG Subcommittee
Matthijs VanWaveren, Secretary, SPEC HPG Committee
Ron Lieberman, Past Chair, SPEC HPG Committee
Copyright © 1999-2010 Standard Performance Evaluation Corporation
All Rights Reserved