SPEChpc™ 2021 Large Result

Copyright 2021-2023 Standard Performance Evaluation Corporation

Intel

Endeavour: Intel Server D50DNP2MFALACB (Intel
Xeon Platinum 8480+)

SPEChpc 2021_lrg_base = 1.23

SPEChpc 2021_lrg_peak = 1.25

hpc2021 License: 13 Test Date: Jul-2023
Test Sponsor: Intel Hardware Availability: Jan-2023
Tested by: Intel Software Availability: Apr-2023

Benchmark result graphs are available in the PDF report.

Results Table

Benchmark Base Peak
Model Ranks Thrds/Rnk Seconds Ratio Seconds Ratio Seconds Ratio Model Ranks Thrds/Rnk Seconds Ratio Seconds Ratio Seconds Ratio
SPEChpc 2021_lrg_base 1.23
SPEChpc 2021_lrg_peak 1.25
Results appear in the order in which they were run. Bold underlined text indicates a median measurement.
805.lbm_l OMP 3584 1 1450 1.880 1456 1.870 1450 1.880 OMP 3584 1 1450 1.880 1456 1.870 1450 1.880
818.tealeaf_l OMP 3584 1 1514 0.958 1517 0.956 1528 0.949 OMP 3584 1 1514 0.958 1517 0.956 1528 0.949
819.clvleaf_l OMP 3584 1 2935 0.716 2792 0.752 2876 0.730 OMP 3584 1 2509 0.837 2722 0.771 2588 0.811
828.pot3d_l OMP 3584 1 4847 0.939 4879 0.932 4849 0.938 OMP 1792 2 4816 0.945 4813 0.945 4827 0.943
834.hpgmgfv_l OMP 3584 1 2030 1.650 2003 1.670 2004 1.670 OMP 3584 1 2030 1.650 2003 1.670 2004 1.670
835.weather_l OMP 3584 1 2045 1.670 1980 1.730 2105 1.630 OMP 3584 1 2045 1.670 1980 1.730 2105 1.630
Hardware Summary
Type of System: Homogenous Cluster
Compute Node: Intel Server D50DNP2MFALACB (Xeon 8480+)
Interconnect: Mellanox HDR
Compute Nodes Used: 32
Total Chips: 64
Total Cores: 3584
Total Threads: 7168
Total Memory: 16 TB
Max. Peak Threads: 2
Software Summary
Compiler: Intel oneAPI Compiler 2023.1.0
MPI Library: Intel MPI Library 2021.9 for Linux OS
Other MPI Info: None
Other Software: None
Base Parallel Model: OMP
Base Ranks Run: 3584
Base Threads Run: 1
Peak Parallel Models: OMP
Minimum Peak Ranks: 1792
Maximum Peak Ranks: 3584
Max. Peak Threads: 2
Min. Peak Threads: 1

Node Description: Intel Server D50DNP2MFALACB (Xeon 8480+)

Hardware
Number of nodes: 32
Uses of the node: Compute
Vendor: Intel
Model: Intel Server D50DNP2MFALACB (Xeon 8480+)
CPU Name: Intel Xeon Platinum 8480+
CPU(s) orderable: 1, 2 chips
Chips enabled: 2
Cores enabled: 112
Cores per chip: 56
Threads per core: 2
CPU Characteristics: Turbo Boost Technology up to 3.8 GHz
CPU MHz: 2000
Primary Cache: 32 KB I + 48 KB D on chip per core
Secondary Cache: 2 MB I+D on chip per core
L3 Cache: 105 MB I+D on chip per chip
Other Cache: None
Memory: 512 GB (16 x 32 GB 2Rx8 PC5-4800B)
Disk Subsystem: 1 x 1 TB NVMe U.2 2.5" SSD
Other Hardware: None
Accel Count: None
Accel Model: None
Accel Vendor: None
Accel Type: None
Accel Connection: None
Accel ECC enabled: None
Accel Description: None
Adapter: Mellanox ConnectX-6 HDR
Number of Adapters: 1
Slot Type: PCI-Express 4.0 x16
Data Rate: 200Gbit/s
Ports Used: 1
Interconnect Type: Mellanox HDR
Software
Accelerator Driver: None
Adapter: Mellanox ConnectX-6 HDR
Adapter Driver: 5.9-0.5.5
Adapter Firmware: 20.36.1010
Operating System: Rocky Linux 8.7 (Green Obsidian)
4.18.0-372.32.1.el8_6.crt3.x86_64
Local File System: NFS
Shared File System: PANASAS FS
System State: Multi-user
Other Software: None

Interconnect Description: Mellanox HDR

Hardware
Vendor: Mellanox
Model: Mellanox HDR
Switch Model: Mellanox MQM8790-HS2F Quantum HDR
InfiniBand Switch
Number of Switches: 18
Number of Ports: 40
Data Rate: 200 Gbit/s
Firmware: 20.36.1010
Topology: Fat-tree
Primary Use: MPI Traffic
Software

Submit Notes

The config file option 'submit' was used.

General Notes

The PANASAS filesystem as described on this result page was formerly
generally available.  At the time of this publication, it may
not be shipping, and/or may not be supported, and/or may fail
to meet other tests of General Availability described in the
SPEC HPG Policy document, http://www.spec.org/hpg/policy.html

Compiler Version Notes

==============================================================================
 CC  805.lbm_l(base, peak) 818.tealeaf_l(base, peak) 834.hpgmgfv_l(base,
      peak)
------------------------------------------------------------------------------
Intel(R) oneAPI DPC++/C++ Compiler 2023.1.0 (2023.1.0.20230320)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir:
  /global/panfs01/admin/opt/intel/oneAPI/2023.1.0.46401/compiler/2023.1.0/linux/bin-llvm
Configuration file:
  /global/panfs01/admin/opt/intel/oneAPI/2023.1.0.46401/compiler/2023.1.0/linux/bin-llvm/../bin/icx.cfg
------------------------------------------------------------------------------

==============================================================================
 FC  819.clvleaf_l(peak) 828.pot3d_l(peak)
------------------------------------------------------------------------------
ifort (IFORT) 2021.9.0 20230302
Copyright (C) 1985-2023 Intel Corporation.  All rights reserved.
------------------------------------------------------------------------------

==============================================================================
 FC  819.clvleaf_l(base) 828.pot3d_l(base) 835.weather_l(base, peak)
------------------------------------------------------------------------------
ifx (IFX) 2023.1.0 20230320
Copyright (C) 1985-2023 Intel Corporation. All rights reserved.
------------------------------------------------------------------------------

Base Compiler Invocation

C benchmarks:

 mpiicc -cc=icx 

Fortran benchmarks:

 mpiifort -fc=ifx 

Base Portability Flags

805.lbm_l:  -lstdc++   -std=c++14 
818.tealeaf_l:  -lstdc++   -std=c++14 
834.hpgmgfv_l:  -lstdc++   -std=c++14 

Base Optimization Flags

C benchmarks:

 -O3   -Ofast   -xCORE-AVX512   -mprefer-vector-width=512   -qopt-multiple-gather-scatter-by-shuffles   -fiopenmp   -ffast-math   -flto   -funroll-loops 

Fortran benchmarks:

 -O3   -Ofast   -xCORE-AVX512   -mprefer-vector-width=512   -qopt-multiple-gather-scatter-by-shuffles   -fiopenmp   -ffast-math   -flto   -funroll-loops   -nostandard-realloc-lhs   -align array64byte 

Base Other Flags

C benchmarks:

 -Wno-incompatible-function-pointer-types 

Peak Compiler Invocation

C benchmarks:

 mpiicc -cc=icx 

Fortran benchmarks (except as noted below):

 mpiifort 
835.weather_l:  mpiifort -fc=ifx 

Peak Portability Flags

805.lbm_l:  -lstdc++   -std=c++14 
818.tealeaf_l:  -lstdc++   -std=c++14 
834.hpgmgfv_l:  -lstdc++   -std=c++14 

Peak Optimization Flags

C benchmarks:

805.lbm_l:  basepeak = yes 
818.tealeaf_l:  basepeak = yes 
834.hpgmgfv_l:  basepeak = yes 

Fortran benchmarks:

819.clvleaf_l:  -O3   -Ofast   -xCORE-AVX512   -ansi-alias   -qopenmp   -ipo   -qopt-zmm-usage=high   -qopt-multiple-gather-scatter-by-shuffles   -nostandard-realloc-lhs   -align array64byte 
828.pot3d_l:  Same as 819.clvleaf_l 
835.weather_l:  basepeak = yes 

Peak Other Flags

C benchmarks:

 -Wno-incompatible-function-pointer-types 

The flags file that was used to format this result can be browsed at
http://www.spec.org/hpc2021/flags/Intel_compiler_flags.2023-08-16.html.

You can also download the XML flags source by saving the following link:
http://www.spec.org/hpc2021/flags/Intel_compiler_flags.2023-08-16.xml.