Hewlett Packard Enterprise ProLiant DL560 Gen10 378668 SPECjbb2015-Distributed max-jOPS
27699 SPECjbb2015-Distributed critical-jOPS
Tested by: Hewlett Packard Enterprise Test Sponsor: Hewlett Packard Enterprise Test location: Houston, TX Test date: March 07, 2019
SPEC license #: 3 Hardware Availability: Apr-2019 Software Availability: Jan-2019 Publication: Tue Apr 2 15:05:14 EDT 2019
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorHewlett Packard Enterprise
Vendor URLhttp://hpe.com/
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYes
Total Nodes1
All Nodes IdenticalYes
Nodes Per System1
Total Chips4
Total Cores112
Total Threads224
Total Memory Amount (GB)384
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameProLiant DL560 Gen10
VendorHewlett Packard Enterprise
Vendor URLhttp://hpe.com/
AvailableApr-2019
ModelProLiant DL560 Gen10
Form Factor2U Rack
CPU NameIntel Xeon Platinum 8280L
CPU Characteristics28 Core, 2.7 GHz, 38.5 MB L3 Cache (Turbo Boost Technology up to 4.0 GHz)
Number of Systems1
Nodes Per System1
Chips Per System4
Cores Per System112
Cores Per Chip28
Threads Per System224
Threads Per Core2
VersionU34 2.00 02/02/2019
CPU Frequency (MHz)2700
Primary Cache32 KB I + 32 KB D on chip per core
Secondary Cache1024 KB I+D on chip per core
Tertiary Cache38.5 MB I+D on chip per chip
Other CacheNone
Disk2 x 400 GB SSD SATA
File SystemXFS
Memory Amount (GB)384
# and size of DIMM(s)48 x 8 GB
Memory Details8 GB 2Rx8 PC4-2666V-R
# and type of Network Interface Cards (NICs)HP Ethernet 1Gb 4-port
Power Supply Quantity and Rating (W)4 x 1600
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise Server 15
VendorSUSE
Vendor URLhttp://suse.com/
Version4.12.14-23-default
AvailableJul-2018
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 11.0.2
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 11.0.2
AvailableJan-2019
Bitness64
NotesNone
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware hw_2
NameSynergy 660 Gen10
VendorHewlett Packard Enterprise
Vendor URLhttp://hpe.com/
AvailableApr-2019
ModelSynergy 660 Gen10
Form FactorFull-Height Compute Module
CPU NameIntel Xeon Platinum 8280
CPU Characteristics28 Core, 2.7 GHz, 38.5 MB L3 Cache (Turbo Boost Technology up to 4.0 GHz)
Number of Systems1
Nodes Per System1
Chips Per System4
Cores Per System112
Cores Per Chip28
Threads Per System224
Threads Per Core2
VersionI43 2.00 02/02/2019
CPU Frequency (MHz)2700
Primary Cache32 KB I + 32 KB D on chip per core
Secondary Cache1024 KB I+D on chip per core
Tertiary Cache38.5 MB I+D on chip per chip
Other CacheNone
Disk2 x 400 GB SSD SATA
File SystemXFS
Memory Amount (GB)768
# and size of DIMM(s)48 x 16 GB
Memory Details16 GB 2Rx8 PC4-2933Y-R
# and type of Network Interface Cards (NICs)Synergy 3820C 10/20Gb CNA
Power Supply Quantity and Rating (W)6 x 2650
Other HardwareNone
Cabinet/Housing/EnclosureSynergy 12000 Frame
Shared DescriptionNone
Shared CommentNone
Notes
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
Other Hardware network_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_2
NameSUSE Linux Enterprise Server 15
VendorSUSE
Vendor URLhttp://suse.com/
Version4.12.14-23-default
AvailableJul-2018
Bitness64
NotesNone
Java Virtual Machine jvm_2
NameOracle Java SE 11.0.2
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 11.0.2
AvailableJan-2019
Bitness64
NotesNone
Other Software other_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning
  • Workload Profile=High Performance Compute
  • Sub-NUMA Clustering=Enabled
  • Thermal Configuration=Maximum Cooling
  • Memory Partrol Scrubbing=Disabled
  • Enhanced Processor Performance=Enabled
  • LLC Prefetcher=Enabled
  • Process Jitter Control=Manual-tuned
  • Process Jitter Control Frequency=3200
Notes None
OS Image os_Image_1
JVM Instances jvm_Backend_1(8)
OS Image Description os_1
Tuning
  • tuned-adm profile=throughput-performance
  • ulimit -n 65535
  • echo 16 > /proc/sys/kernel/sched_nr_migrate
  • echo 16000000 > /proc/sys/kernel/sched_latency_ns
  • echo 30000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 990000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 1000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • Added 'processor.max_cstate=1 intel_idle.max_cstate=0' to GRUB_CMDLINE_LINUX_DEFAULT
Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-showversion -server -XX:AllocatePrefetchInstr=2 -XX:+UseParallelOldGC -XX:ParallelGCThreads=28 -XX:LargePageSizeInBytes=2m -XX:+AggressiveOpts -XX:-UseAdaptiveSizePolicy -XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseLargePages -Xms30g -Xmx30g -Xmn27g -XX:SurvivorRatio=28 -XX:TargetSurvivorRatio=95 -XX:MaxTenuringThreshold=15 -Xnoclassgc -XX:+UseRTMLocking -XX:InlineSmallCode=10k -XX:MaxGCPauseMillis=300 -XX:+UseRTMDeopt -XX:UseAVX=0 -XX:LoopUnrollLimit=20 -XX:AdaptiveSizeMajorGCDecayTimeScale=12 -XX:AdaptiveSizeDecrementScaleFactor=2

Tuning None
Notes

Used numactl to affinitize each Backend JVM to physical cores in a NUMA node.

  • numactl --physcpubind=0-13,56-69 --membind=0
  • numactl --physcpubind=14-27,70-83 --membind=1
  • numactl --physcpubind=28-41,84-97 --membind=2
  • numactl --physcpubind=42-55,98-111 --membind=3
Hardware
OS Images os_Image_2(1)
Hardware Description hw_2
Number of Systems 1
SW Environment non-virtual
Tuning
  • Workload Profile=High Performance Compute
  • Sub-NUMA Clustering=Enabled
  • Thermal Configuration=Maximum Cooling
  • Memory Partrol Scrubbing=Disabled
  • Enhanced Processor Performance=Enabled
  • LLC Prefetcher=Enabled
  • Process Jitter Control=Manual-tuned
  • Process Jitter Control Frequency=3200
Notes None
OS Image os_Image_2
JVM Instances jvm_Ctr_1(1), jvm_TxInjector_1(8)
OS Image Description os_2
Tuning
  • tuned-adm profile=throughput-performance
  • ulimit -n 65535
  • echo 16 > /proc/sys/kernel/sched_nr_migrate
  • echo 16000000 > /proc/sys/kernel/sched_latency_ns
  • echo 30000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 990000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 1000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • Added 'processor.max_cstate=1 intel_idle.max_cstate=0' to GRUB_CMDLINE_LINUX_DEFAULT
Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_2
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseParallelOldGC

Tuning None
Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_2
Command Line

-Xms2g -Xmx2g -Xmn1536m -XX:+UseParallelOldGC

Tuning None
Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 373935 378668 383401 388135 392868
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 26033 26033 26033 26033 35500 27699
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us - / 4733 - / 4733 - / 4733 - / 4733 - / 4733 - / 4733
1000us 85200 / 89934 14200 / 18933 9467 / 14200 4733 / 9467 - / 4733 - / 4733
5000us 302934 / 298201 198801 / 203534 71000 / 75734 37867 / 42600 23667 / 28400 - / 4733
10000us 321868 / 312401 250868 / 255601 94667 / 85200 42600 / 47333 23667 / 28400 4733 / 9467
25000us 326601 / 331334 288734 / 284001 118334 / 113600 71000 / 47333 23667 / 28400 4733 / 9467
50000us 331334 / 336068 293468 / 298201 146734 / 132534 71000 / 47333 23667 / 28400 4733 / 9467
75000us 340801 / 345535 307668 / 298201 184601 / 189334 94667 / 75734 23667 / 28400 4733 / 9467
100000us 345535 / 350268 317134 / 312401 222467 / 217734 127800 / 132534 33133 / 37867 4733 / 9467
200000us 364468 / 369201 331334 / 336068 293468 / 298201 274534 / 279268 94667 / 99400 9467 / 14200
500000us 373935 / 378668 364468 / 369201 336068 / 340801 326601 / 331334 317134 / 321868 66267 / 37867
1000000us 378668 / - 378668 / - 369201 / 373935 369201 / 373935 364468 / 369201 194067 / 118334
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller
specjbb.comm.connect.client.pool.size 256 192
specjbb.comm.connect.selector.runner.count 0 4
specjbb.comm.connect.timeouts.connect 60000 600000
specjbb.comm.connect.timeouts.read 60000 600000
specjbb.comm.connect.timeouts.write 60000 600000
specjbb.comm.connect.worker.pool.max 256 80
specjbb.controller.host localhost 10.10.0.80
specjbb.customerDriver.threads 64 {probe=64, saturate=64}
specjbb.forkjoin.workers 224 {Tier1=210, Tier2=70, Tier3=28}
specjbb.group.count 1 8
specjbb.mapreducer.pool.size 224 28
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 473335 IR
High-bound (settled) is 399532 IR