Hewlett Packard Enterprise ProLiant DL325 Gen11 464954 SPECjbb2015-Distributed max-jOPS
425657 SPECjbb2015-Distributed critical-jOPS
Tested by: Hewlett Packard Enterprise Test Sponsor: Hewlett Packard Enterprise Test location: Houston, TX Test date: September 18, 2024
SPEC license #: 3 Hardware Availability: Oct-2024 Software Availability: Jul-2024 Publication: Thu Oct 10 13:03:35 EDT 2024
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorHewlett Packard Enterprise
Vendor URLhttp://www.hpe.com/
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips1
Total Cores160
Total Threads320
Total Memory Amount (GB)768
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameProLiant DL325 Gen11
VendorHewlett Packard Enterprise
Vendor URLhttp://hpe.com/
AvailableOct-2024
ModelProLiant DL325 Gen11
Form Factor1U Rack
CPU NameAMD EPYC 9845
CPU Characteristics160 Core, 2.1 GHz, 320 MB L3 Cache(Max. Boost Clock Up to 3.7 GHz)
Number of Systems1
Nodes Per System1
Chips Per System1
Cores Per System160
Cores Per Chip160
Threads Per System320
Threads Per Core2
VersionA56 v2.10 09/11/2024
CPU Frequency (MHz)2100
Primary Cache32 KB I + 48 KB D on chip per core
Secondary Cache1024 KB I+D on chip per core
Tertiary Cache320 MB (I+D) on chip per chip
Other CacheNone
Disk1 x 480 GB NVMe SSD
File Systembtrfs
Memory Amount (GB)768
# and size of DIMM(s)12 x 64 GB
Memory Details64GB 2Rx4 DDR5 RDIMM 6400 MHz, running at 6000 MHz
# and type of Network Interface Cards (NICs)HPE Ethernet 1Gb 4-port
Power Supply Quantity and Rating (W)2 x 800
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise Server 15 SP6
VendorSUSE
Vendor URLhttp://suse.com/
Version6.4.0-150600.21-default
AvailableJun-2024
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 22.0.2
VendorOracle
Vendor URLhttp://www.oracle.com/
VersionJava HotSpot 64-bit Server VM, version 22.0.2
AvailableJul-2024
Bitness64
NotesNone
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware hw_2
NameProLiant DL385 Gen11
VendorHewlett Packard Enterprise
Vendor URLhttp://hpe.com/
AvailableOct-2024
ModelProLiant DL385 Gen11
Form Factor2U Rack
CPU NameAMD EPYC 9845
CPU Characteristics160 Core, 2.1 GHz, 320 MB L3 Cache(Max. Boost Clock Up to 3.7 GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System320
Cores Per Chip160
Threads Per System640
Threads Per Core2
VersionA56 v2.10 09/11/2024
CPU Frequency (MHz)2100
Primary Cache32KB(I)+48KB(D) per core
Secondary Cache1MB (I+D) per core
Tertiary Cache320MB (I+D) on chip per chip
Other CacheNone
Disk1 x 480 GB NVMe SSD
File Systembtrfs
Memory Amount (GB)1536
# and size of DIMM(s)24 x 64GB
Memory Details64GB 2Rx4 DDR5 RDIMM 6400 MHz, running at 6000 MHz.
# and type of Network Interface Cards (NICs)HPE Ethernet 10Gb 2-port
Power Supply Quantity and Rating (W)2 x 1600w
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_2
NameSUSE Linux Enterprise Server 15 SP6
VendorSUSE
Vendor URLhttp://suse.com/
Version6.4.0-150600.21-default
AvailableJun-2024
Bitness64
NotesNone
Java Virtual Machine jvm_2
NameOracle Java SE 22.0.2
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 22.0.2
AvailableJul-2024
Bitness64
NotesNone
Other Software other_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning
  • Workload Profile=High Performance Compute(HPC)
  • Thermal Configuration=Enhanced Cooling
  • Determinism Control=Manual
  • Performance Determinism=Power Deterministic
  • Memory Patrol Scrubbing=Disabled
  • Numa Memory Domains Per Socket(NPS)=Two Memory Domains Per Socket
  • L1 Stream HW Prefetcher=Enabled
  • L2 Stream HW Prefetcher=Enabled
  • Minimum Processor Idle Power Core C-State=No C-states
  • Package Power Limit=390
Notes None
OS Image os_Image_1
JVM Instances jvm_Backend_1(6)
OS Image Description os_1
Tuning

  • tuned-adm profile throughput-performance
  • ulimit -n 1024000

  • echo 950000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 100000000 > /proc/sys/kernel/sched_latency_ns
  • echo 80000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 300000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 300000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 32 > /proc/sys/kernel/sched_nr_migrate
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo 0 > /proc/sys/vm/numa_stat
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag

Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-Xms120g -Xmx120g -Xmn118g -server -XX:MetaspaceSize=256m -XX:AllocatePrefetchInstr=2 -XX:LargePageSizeInBytes=2m -XX:-UsePerfData -XX:-UseAdaptiveSizePolicy -XX:+AlwaysPreTouch -XX:+UseLargePages -XX:+UseParallelGC -XX:SurvivorRatio=100 -XX:TargetSurvivorRatio=90 -XX:ParallelGCThreads=50 -XX:MaxTenuringThreshold=15 -XX:InitialCodeCacheSize=25m -XX:InlineSmallCode=10k -XX:MaxGCPauseMillis=200 -XX:+UseCompressedOops -XX:ObjectAlignmentInBytes=32 -XX:+UseTransparentHugePages -XX:TLABAllocationWeight=55 -XX:ThreadStackSize=512 -XX:CompileThresholdScaling=120

Tuning

Used numactl to affinitize three Backend JVMs to a NUMA node

  • Group1: numactl --cpunodebind=0 --localalloc
  • Group2: numactl --cpunodebind=0 --localalloc
  • Group3: numactl --cpunodebind=0 --localalloc
  • Group4: numactl --cpunodebind=1 --localalloc
  • Group5: numactl --cpunodebind=1 --localalloc
  • Group6: numactl --cpunodebind=1 --localalloc

Notes None
Hardware
OS Images os_Image_2(1)
Hardware Description hw_2
Number of Systems 1
SW Environment non-virtual
Tuning
  • Workload Profile=High Performance Compute(HPC)
  • Thermal Configuration=Enhanced Cooling
  • Determinism Control=Manual
  • Performance Determinism=Power Deterministic
  • Memory Patrol Scrubbing=Disabled
  • Numa Memory Domains Per Socket(NPS)=One Memory Domains Per Socket
  • L1 Stream HW Prefetcher=Enabled
  • L2 Stream HW Prefetcher=Enabled
  • xGMI Link Bandwidth=32Gbps
  • Minimum Processor Idle Power Core C-State=No C-states
  • Package Power Limit=390
Notes None
OS Image os_Image_2
JVM Instances jvm_Ctr_1(1), jvm_TxInjector_1(6)
OS Image Description os_2
Tuning

  • tuned-adm profile throughput-performance
  • ulimit -n 1024000

  • echo 950000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 100000000 > /proc/sys/kernel/sched_latency_ns
  • echo 80000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 300000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 300000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 32 > /proc/sys/kernel/sched_nr_migrate
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo 0 > /proc/sys/vm/numa_stat
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag

Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_2
Command Line

-Xms25g -Xmx25g -Xmn20g -XX:+UseParallelGC -XX:ParallelGCThreads=10 -XX:CICompilerCount=2

Tuning None
Notes

Used numactl to interleave memory on all Nodes in Driver system

  • numactl --interleave=all

JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_1
Command Line

-Xms10g -Xmx10g -Xmn8g -XX:+UseParallelGC -XX:ParallelGCThreads=10 -XX:CICompilerCount=4

Tuning None
Notes

Used numactl to affinitize 3 Transaction Injector JVM to one NUMA node in Driver system

  • Group1:numactl --cpunodebind=0 --membind=0
  • Group2:numactl --cpunodebind=0 --membind=0
  • Group3:numactl --cpunodebind=0 --membind=0
  • Group4:numactl --cpunodebind=1 --membind=1
  • Group5:numactl --cpunodebind=1 --membind=1
  • Group6:numactl --cpunodebind=1 --membind=1

max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Pass Fail Fail
jOPS 454735 459844 464954 470063 475172
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 344883 421524 447070 462399 464954 425657
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 25547 / 30656 - / 5109 - / 5109 - / 5109 - / 5109 - / 5109
1000us 444516 / 71531 30656 / 35766 5109 / 10219 5109 / 10219 - / 5109 - / 5109
5000us 464954 / - 464954 / - 332110 / 76641 311672 / 76641 183938 / 71531 30656 / 15328
10000us 464954 / - 464954 / - 464954 / - 459844 / 464954 342328 / 347438 30656 / 15328
25000us 464954 / - 464954 / - 464954 / - 464954 / - 418969 / 424079 30656 / 15328
50000us 464954 / - 464954 / - 464954 / - 464954 / - 444516 / 449625 199266 / 25547
75000us 464954 / - 464954 / - 464954 / - 464954 / - 459844 / 464954 327000 / 235031
100000us 464954 / - 464954 / - 464954 / - 464954 / - 464954 / - 383203 / 332110
200000us 464954 / - 464954 / - 464954 / - 464954 / - 464954 / - 444516 / 424079
500000us 464954 / - 464954 / - 464954 / - 464954 / - 464954 / - 464954 / -
1000000us 464954 / - 464954 / - 464954 / - 464954 / - 464954 / - 464954 / -
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller Group1.Backend.beJVM Group1.TxInjector.txiJVM1 Group2.Backend.beJVM Group2.TxInjector.txiJVM1 Group3.Backend.beJVM Group3.TxInjector.txiJVM1 Group4.Backend.beJVM Group4.TxInjector.txiJVM1 Group5.Backend.beJVM Group5.TxInjector.txiJVM1 Group6.Backend.beJVM Group6.TxInjector.txiJVM1
specjbb.comm.connect.client.pool.size 256 256 120 120 120 120 120 120 120 120 120 120 120 120
specjbb.comm.connect.selector.runner.count 0 4
specjbb.comm.connect.timeouts.connect 60000 900000
specjbb.comm.connect.timeouts.read 60000 800000
specjbb.comm.connect.timeouts.write 60000 800000
specjbb.comm.connect.worker.pool.max 256 256 120 120 120 120 120 120 120 120 120 120 120 120
specjbb.comm.connect.worker.pool.min 1 1 24 24 24 24 24 24 24 24 24 24 24 24
specjbb.controller.host localhost 172.18.28.16
specjbb.controller.maxir.maxFailedPoints 3 1
specjbb.forkjoin.workers 640 {Tier1=110, Tier2=1, Tier3=8}
specjbb.group.count 1 6
specjbb.heartbeat.period 10000 400000
specjbb.heartbeat.threshold 100000 4000000
specjbb.mapreducer.pool.size 640 6
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 510938 IR
High-bound (settled) is 483120 IR