MPI2007 license: | 13 | Test date: | Mar-2010 |
---|---|---|---|
Test sponsor: | Intel Corporation | Hardware Availability: | Mar-2010 |
Tested by: | Pavel Shelepugin | Software Availability: | Feb-2010 |
Benchmark | Base | Peak | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Ranks | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | Ranks | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | |
Results appear in the order in which they were run. Bold underlined text indicates a median measurement. | ||||||||||||||
121.pop2 | 1536 | 156 | 24.9 | 148 | 26.2 | 148 | 26.3 | |||||||
122.tachyon | 1536 | 557 | 3.49 | 107 | 18.2 | 111 | 17.5 | |||||||
125.RAxML | 1536 | 206 | 14.2 | 204 | 14.3 | 205 | 14.3 | |||||||
126.lammps | 1536 | 74.3 | 33.1 | 74.4 | 33.0 | 73.7 | 33.3 | |||||||
128.GAPgeofem | 1536 | 231 | 25.6 | 237 | 25.0 | 227 | 26.1 | |||||||
129.tera_tf | 1536 | 73.7 | 14.9 | 76.3 | 14.4 | 74.4 | 14.8 | |||||||
132.zeusmp2 | 1536 | 54.2 | 39.1 | 56.0 | 37.8 | 55.9 | 37.9 | |||||||
137.lu | 1536 | 54.3 | 77.4 | 52.7 | 79.7 | 53.4 | 78.7 | |||||||
142.dmilc | 1536 | 46.3 | 79.6 | 46.5 | 79.3 | 47.1 | 78.1 | |||||||
143.dleslie | 1536 | 63.8 | 48.6 | 64.9 | 47.7 | 63.9 | 48.5 | |||||||
145.lGemsFDTD | 1536 | 108 | 40.7 | 109 | 40.6 | 108 | 40.8 | |||||||
147.l2wrf2 | 1536 | 180 | 45.5 | 181 | 45.2 | 184 | 44.5 |
Hardware Summary | |
---|---|
Type of System: | Homogeneous |
Compute Node: | Endeavor Node |
Interconnects: | IB Switch Gigabit Ethernet |
File Server Node: | HOME |
Total Compute Nodes: | 128 |
Total Chips: | 256 |
Total Cores: | 1536 |
Total Threads: | 1536 |
Total Memory: | 3 TB |
Base Ranks Run: | 1536 |
Minimum Peak Ranks: | -- |
Maximum Peak Ranks: | -- |
Software Summary | |
---|---|
C Compiler: | Intel C++ Compiler 11.1.064 for Linux |
C++ Compiler: | Intel C++ Compiler 11.1.064 for Linux |
Fortran Compiler: | Intel Fortran Compiler 11.1.064 for Linux |
Base Pointers: | 64-bit |
Peak Pointers: | 64-bit |
MPI Library: | MVAPICH 1.1 |
Other MPI Info: | None |
Pre-processors: | No |
Other Software: | None |
Hardware | |
---|---|
Number of nodes: | 128 |
Uses of the node: | compute |
Vendor: | Intel |
Model: | SR1600UR |
CPU Name: | Intel Xeon X5670 |
CPU(s) orderable: | 1-2 chips |
Chips enabled: | 2 |
Cores enabled: | 12 |
Cores per chip: | 6 |
Threads per core: | 1 |
CPU Characteristics: | Intel Turbo Boost Technology disabled, 6.4 GT/s QPI, Hyper-Threading disabled |
CPU MHz: | 2934 |
Primary Cache: | 32 KB I + 32 KB D on chip per core |
Secondary Cache: | 256 KB I+D on chip per core |
L3 Cache: | 12 MB I+D on chip per chip, 12 MB shared / 6 cores |
Other Cache: | None |
Memory: | 24 GB (RDIMM 6x4-GB DDR3-1333 MHz) |
Disk Subsystem: | Seagate 400 GB ST3400755SS |
Other Hardware: | None |
Adapter: | Intel (ESB2) 82575EB Dual-Port Gigabit Ethernet Controller |
Number of Adapters: | 1 |
Slot Type: | PCI-Express x8 |
Data Rate: | 1Gbps Ethernet |
Ports Used: | 2 |
Interconnect Type: | Ethernet |
Adapter: | Mellanox MHQH29-XTC |
Number of Adapters: | 1 |
Slot Type: | PCIe x8 Gen2 |
Data Rate: | InfiniBand 4x QDR |
Ports Used: | 1 |
Interconnect Type: | InfiniBand |
Software | |
---|---|
Adapter: | Intel (ESB2) 82575EB Dual-Port Gigabit Ethernet Controller |
Adapter Driver: | e1000 |
Adapter Firmware: | None |
Adapter: | Mellanox MHQH29-XTC |
Adapter Driver: | OFED 1.4.2 |
Adapter Firmware: | 2.7.000 |
Operating System: | Red Hat EL 5.4, kernel 2.6.18-164 |
Local File System: | Linux/ext2 |
Shared File System: | NFS |
System State: | Multi-User |
Other Software: | PBS Pro 10.1 |
Hardware | |
---|---|
Number of nodes: | 1 |
Uses of the node: | fileserver |
Vendor: | Intel |
Model: | SSR212CC |
CPU Name: | Intel Xeon CPU |
CPU(s) orderable: | 2 chips |
Chips enabled: | 2 |
Cores enabled: | 2 |
Cores per chip: | 1 |
Threads per core: | 1 |
CPU Characteristics: | -- |
CPU MHz: | 2800 |
Primary Cache: | 12 KB I + 16 KB D on chip per chip |
Secondary Cache: | 1 MB I+D on chip per chip |
L3 Cache: | None |
Other Cache: | None |
Memory: | 6 GB |
Disk Subsystem: | 10 disks, 320GB/disk, 2.6TB total |
Other Hardware: | None |
Adapter: | Intel 82546GB Dual-Port Gigabit Ethernet Controller |
Number of Adapters: | 1 |
Slot Type: | PCI-Express x8 |
Data Rate: | 1Gbps Ethernet |
Ports Used: | 1 |
Interconnect Type: | Ethernet |
Software | |
---|---|
Adapter: | Intel 82546GB Dual-Port Gigabit Ethernet Controller |
Adapter Driver: | e1000 |
Adapter Firmware: | N/A |
Operating System: | RedHat EL 4 Update 4 |
Local File System: | None |
Shared File System: | NFS |
System State: | Multi-User |
Other Software: | None |
Hardware | |
---|---|
Vendor: | Mellanox |
Model: | Mellanox MTS3600Q-1UNC |
Switch Model: | Mellanox MTS3600Q-1UNC |
Number of Switches: | 46 |
Number of Ports: | 36 |
Data Rate: | InfiniBand 4x QDR |
Firmware: | 7.1.000 |
Topology: | Fat tree |
Primary Use: | MPI traffic |
Hardware | |
---|---|
Vendor: | Force10 Networks |
Model: | Force10 S50, Force10 C300 |
Switch Model: | Force10 S50, Force10 C300 |
Number of Switches: | 15 |
Number of Ports: | 48 |
Data Rate: | 1Gbps Ethernet, 10Gbps Ethernet |
Firmware: | 8.2.1.0 |
Topology: | Fat tree |
Primary Use: | Cluster File System |
The config file option 'submit' was used.
MPI startup command: mpirun command was used to start MPI jobs. BIOS settings: Intel Hyper-Threading Technology (SMT): Disabled (default is Enabled) Intel Turbo Boost Technology (Turbo) : Disabled (default is Enabled) RAM configuration: Compute nodes have 1x4-GB RDIMM on each memory channel. Network: Forty six 36-port switches: 18 core switches and 28 leaf switches. Each leaf has one link to each core. Remaining 18 ports on 25 of 28 leafs are used for compute nodes. On the remaining 3 leafs the ports are used for FS nodes and other peripherals. Job placement: Each MPI job was assigned to a topologically compact set of nodes, i.e. the minimal needed number of leaf switches was used for each job: 1 switch for 96/192 ranks, 2 switches for 384 ranks, 4 switches for 768 ranks, 8 switches for 1536 ranks. PBS Pro was used for job submission. It has no impact on performance. Can be found at: http://www.altair.com
mpicc |
126.lammps: | mpicxx |
mpif90 |
mpicc mpif90 |
121.pop2: | -DSPEC_MPI_CASE_FLAG |
126.lammps: | -DMPICH_IGNORE_CXX_SEEK |