SPEC(R) MPIM2007 Summary Cray Big Red II (AMD Opteron 6380, 2.5 GHz) Thu Apr 2 13:46:26 2015 MPI2007 License: 3440A Test date: Mar-2015 Test sponsor: Indiana University Hardware availability: Apr-2013 Tested by: Indiana University Software availability: Jun-2013 Base Base Base Peak Peak Peak Benchmarks Ranks Run Time Ratio Ranks Run Time Ratio -------------- ------ --------- --------- ------ --------- --------- 104.milc 256 45.2 34.7 * 104.milc 256 45.1 34.7 S 104.milc 256 45.3 34.5 S 107.leslie3d 256 145 36.0 S 107.leslie3d 256 146 35.6 S 107.leslie3d 256 145 35.9 * 113.GemsFDTD 256 426 14.8 S 113.GemsFDTD 256 428 14.7 S 113.GemsFDTD 256 427 14.8 * 115.fds4 256 78.2 25.0 S 115.fds4 256 79.0 24.7 S 115.fds4 256 78.3 24.9 * 121.pop2 256 327 12.6 S 121.pop2 256 326 12.7 * 121.pop2 256 326 12.7 S 122.tachyon 256 110 25.4 * 122.tachyon 256 110 25.4 S 122.tachyon 256 111 25.2 S 126.lammps 256 168 17.4 * 126.lammps 256 168 17.3 S 126.lammps 256 168 17.4 S 127.wrf2 256 144 54.0 * 127.wrf2 256 145 53.8 S 127.wrf2 256 143 54.4 S 128.GAPgeofem 256 53.1 38.9 * 128.GAPgeofem 256 53.1 38.9 S 128.GAPgeofem 256 53.0 39.0 S 129.tera_tf 256 129 21.4 * 129.tera_tf 256 130 21.3 S 129.tera_tf 256 129 21.4 S 130.socorro 256 115 33.1 * 130.socorro 256 116 33.0 S 130.socorro 256 115 33.1 S 132.zeusmp2 256 141 22.0 * 132.zeusmp2 256 140 22.1 S 132.zeusmp2 256 142 21.9 S 137.lu 256 68.6 53.6 * 137.lu 256 68.5 53.7 S 137.lu 256 68.6 53.6 S ============================================================================== 104.milc 256 45.2 34.7 * 107.leslie3d 256 145 35.9 * 113.GemsFDTD 256 427 14.8 * 115.fds4 256 78.3 24.9 * 121.pop2 256 326 12.7 * 122.tachyon 256 110 25.4 * 126.lammps 256 168 17.4 * 127.wrf2 256 144 54.0 * 128.GAPgeofem 256 53.1 38.9 * 129.tera_tf 256 129 21.4 * 130.socorro 256 115 33.1 * 132.zeusmp2 256 141 22.0 * 137.lu 256 68.6 53.6 * SPECmpiM_base2007 27.2 SPECmpiM_peak2007 Not Run BENCHMARK DETAILS ----------------- Type of System: Homogeneous Total Compute Nodes: 16 Total Chips: 32 Total Cores: 512 Total Threads: 512 Total Memory: 1 TB Base Ranks Run: 256 Minimum Peak Ranks: -- Maximum Peak Ranks: -- C Compiler: Intel C Composer XE 2013 for Linux, Version 13.1.3.192 Build 20130607 C++ Compiler: Intel C++ Composer XE 2013 for Linux, Version 13.1.3.192 Build 20130607 Fortran Compiler: Intel Fortran Composer XE 2013 for Linux, Version 13.1.3.192 Build 20130607 Base Pointers: 64-bit Peak Pointers: 64-bit MPI Library: Cray MPI (MPT) 7.1.2 Other MPI Info: None Pre-processors: No Other Software: None Node Description: Big Red II Node ================================= HARDWARE -------- Number of nodes: 16 Uses of the node: compute Vendor: Cray Model: XE6 CPU Name: AMD Opteron 6380 CPU(s) orderable: 1-2 chips Chips enabled: 2 Cores enabled: 32 Cores per chip: 16 Threads per core: 1 CPU Characteristics: AMD Turbo CORE technology up to 3.40 GHz CPU MHz: 2500 Primary Cache: 512 KB I on chip per chip, 64 KB I shared / 2 cores; 16 KB D on chip per core Secondary Cache: 16 MB I+D on chip per chip, 2 MB shared / 2 cores L3 Cache: 16 MB I+D on chip per chip, 8 MB shared / 8 cores Other Cache: None Memory: 64 GB (8 x 8 GB 2Rx4 PC3L-12800R-11, ECC running at 1600 MHz and CL11) Disk Subsystem: None Other Hardware: None Adapter: Mellanox ConnectX MHQH29-XTC Number of Adapters: 1 Slot Type: PCIe x8 Gen 2 Data Rate: 40Gbps Ports Used: 1 Interconnect Type: 40 Gigabit Infiniband (QDR) Adapter: Cray Gemini Number of Adapters: 1 Slot Type: AMD HyperTransport 3 Data Rate: 76.8Gbps Ports Used: 1 Interconnect Type: Gemini SOFTWARE -------- Adapter: Mellanox ConnectX MHQH29-XTC Adapter Driver: 1.0-ofed1.5.4 Adapter Firmware: 2.9.1000 Adapter: Cray Gemini Adapter Driver: Proprietary Cray_kgni Adapter Firmware: 0.17 Operating System: SUSE Linux Enterprise Server 11 (x86_64), Cray Linux Environment 4.2 Kernel 2.6.32.59-0.7.1_1.0402.7496-cray_gem_c Local File System: None Shared File System: lustre System State: Multi-User Other Software: TORQUE-2.5.7 Node Description: Data Capacitor II =================================== HARDWARE -------- Number of nodes: 2 Uses of the node: fileserver Vendor: DDN Model: DDN SFA12K CPU Name: Intel Xeon CPU E5-2620 CPU(s) orderable: 1-2 chips Chips enabled: 2 Cores enabled: 12 Cores per chip: 6 Threads per core: 1 CPU Characteristics: Intel Turbo Boost Technology up to 2.50 GHz CPU MHz: 2000 Primary Cache: 32 KB I + 32 KB D on chip per core Secondary Cache: 256 KB I+D on chip per core L3 Cache: 15 MB I+D on chip per chip Other Cache: None Memory: 96 GB Disk Subsystem: 30 TB RAID 6, 10 (8 + 2) x 3 TB SATA (Hitachi, 7200RPM, 6.0Gbps) Other Hardware: None Adapter: Mellanox ConnectX MHQH29-XTC Number of Adapters: 1 Slot Type: PCIe x8 Gen 2 Data Rate: 40Gbps Ports Used: 1 Interconnect Type: 40 Gigabit Infiniband (QDR) SOFTWARE -------- Adapter: Mellanox ConnectX MHQH29-XTC Adapter Driver: 1.0-ofed1.5.4 Adapter Firmware: 2.9.1000 Operating System: CentOS 6.2 Local File System: Linux/ext4 Shared File System: lustre System State: Multi-User Other Software: None Interconnect Description: Infiniband (QDR) ========================================== HARDWARE -------- Vendor: DDN Model: Mellanox SX6506 Switch Model: Mellanox SX6506 Number of Switches: 1 Number of Ports: 108 Data Rate: 56 Gbps Firmware: mellanox SX6506 Topology: switched Primary Use: Lustre fileserver Interconnect Description: Cray Gemini ===================================== HARDWARE -------- Vendor: Cray Model: Cray Gemini Switch Model: Cray Gemini Number of Switches: 264 Number of Ports: 48 Data Rate: 9.36 GB/s Firmware: 0.17 Topology: 3D Torus Primary Use: MPI traffic Submit Notes ------------ The config file option 'submit' was used. General Notes ------------- 130.socorro (base): "nullify_ptrs" src.alt was used. MPI startup command: aprun command was used to start MPI jobs. A flag below is used to place processes onto 16 cores out of 32 on a node: -cc 0,2,4,6,8,10,12,14,16,18,20,22,24,26,28,30 export MPICH_NO_BUFFER_ALIAS_CHECK=true If set, the buffer alias error check for collectives is disabled. The MPI standard does not allow aliasing of type OUT or INOUT parameters on the same collective function call. The default is false. Network: 3D Torus Job placement: PBS is used for job placement. Compute nodes are selected by PBS. No specific node selection is used. Base Compiler Invocation ------------------------ C benchmarks: cc C++ benchmarks: 126.lammps: CC Fortran benchmarks: ftn Benchmarks using both Fortran and C: cc ftn Base Portability Flags ---------------------- 121.pop2: -DSPEC_MPI_CASE_FLAG 126.lammps: -DMPICH_IGNORE_CXX_SEEK 127.wrf2: -DSPEC_MPI_CASE_FLAG -DSPEC_MPI_LINUX 130.socorro: -assume nostd_intent_in Base Optimization Flags ----------------------- C benchmarks: -O3 -no-prec-div C++ benchmarks: 126.lammps: -O3 -no-prec-div Fortran benchmarks: -O3 -no-prec-div Benchmarks using both Fortran and C: -O3 -no-prec-div The flags file that was used to format this result can be browsed at http://www.spec.org/mpi2007/flags/EM64T_Intel140_flags.20150429.html You can also download the XML flags source by saving the following link: http://www.spec.org/mpi2007/flags/EM64T_Intel140_flags.20150429.xml SPEC and SPEC MPI are registered trademarks of the Standard Performance Evaluation Corporation. All other brand and product names appearing in this result are trademarks or registered trademarks of their respective holders. ----------------------------------------------------------------------------- For questions about this result, please contact the tester. For other inquiries, please contact webmaster@spec.org. Copyright 2006-2010 Standard Performance Evaluation Corporation Tested with SPEC MPI2007 v2.0.1. Report generated on Wed Apr 29 12:32:28 2015 by MPI2007 ASCII formatter v1463. Originally published on 29 April 2015.