Super Micro Computer, Inc Supermicro A+ AS-1115CS-TNR 394739 SPECjbb2015-Distributed max-jOPS
219662 SPECjbb2015-Distributed critical-jOPS
Tested by: Super Micro Computer, Inc Test Sponsor: Super Micro Computer, Inc Test location: San Jose, California Test date: October 15, 2022
SPEC license #: 001176 Hardware Availability: Nov-2022 Software Availability: Aug-2022 Publication: Thu Nov 10 10:32:32 EST 2022
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorSuper Micro Computer, Inc
Vendor URLhttps://www.supermicro.com
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips1
Total Cores96
Total Threads192
Total Memory Amount (GB)768
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameSupermicro A+ AS-1115CS-TNR
VendorSuper Micro Computer, Inc
Vendor URLhttps://www.supermicro.com
AvailableNov-2022
ModelH13SSW
Form Factor1U
CPU NameAMD EPYC 9654
CPU Characteristics96 core, 2.4GHz, 384MB L3 Cache (Max. Boost Clock up to 3.7GHz)
Number of Systems1
Nodes Per System1
Chips Per System1
Cores Per System96
Cores Per Chip96
Threads Per System192
Threads Per Core2
Version1.0 10/03/2022
CPU Frequency (MHz)2400
Primary Cache32KB(I)+32KB(D) per core
Secondary Cache1MB (I+D) per core
Tertiary Cache384MB (I+D) on chip per chip
Other CacheNone
Disk10 x 1.92 TB NVMe PCIe Gen4.0
File Systembtrfs
Memory Amount (GB)768
# and size of DIMM(s)12 x 64GB
Memory Details64GB 2Rx4 PC5-38400R
# and type of Network Interface Cards (NICs)1 x 100GbE NIC
Power Supply Quantity and Rating (W)2 x 860w
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise Server 15 SP4
VendorSUSE
Vendor URLhttp://suse.com/
Version5.14.21-150400.24.21-default
AvailableJuly-2022
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 18.0.2.1
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 18.0.2.1
AvailableAug-2022
Bitness64
NotesNone
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware hw_2
NameSupermicro A+ AS-1114S-WN10RT
VendorSuper Micro Computer, Inc
Vendor URLhttps://www.supermicro.com
AvailableMar-2021
ModelH12SSW-NTR
Form Factor1U
CPU NameAMD EPYC 7713
CPU Characteristics64 core, 2.00GHz, 256MB L3 Cache (Max. Boost Clock up to 3.7GHz)
Number of Systems1
Nodes Per System1
Chips Per System1
Cores Per System64
Cores Per Chip64
Threads Per System128
Threads Per Core2
Version2.2 07/29/2021
CPU Frequency (MHz)2000
Primary Cache32KB(I)+32KB(D) per core
Secondary Cache512KB (I+D) per core
Tertiary Cache256MB (I+D) on chip per chip
Other CacheNone
Disk1 x 1 TB NVMe PCIe Gen3
File Systemxfs
Memory Amount (GB)128
# and size of DIMM(s)8 x 16GB
Memory Details16GB 2Rx4 PC4-21300V
# and type of Network Interface Cards (NICs)1 x 100GbE NIC
Power Supply Quantity and Rating (W)2 x 700W
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_2
NameRed Hat Enterprise Linux release 8.3
VendorRHEL
Vendor URLhttps://www.redhat.com
Version4.18.0-240.el8.x86_64
AvailableNov-2020
Bitness64
NotesNone
Java Virtual Machine jvm_2
NameOracle Java SE 18.0.2.1
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 18.0.2.1
AvailableAug-2022
Bitness64
NotesNone
Other Software other_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • NUMA nodes per socket = NPS4
  • L3 Cache as NUMA Domain = Enabled
  • Determinism Control = Manual
  • Determinism Slider = Power
  • L1 Stream HW Prefetcher = Disable
  • L2 Stream HW Prefetcher = Disable
  • TDP Control = Manual
  • TDP = 400
  • PPT Control = Manual
  • PPT = 400

Notes None
OS Image os_Image_1
JVM Instances jvm_Backend_1(12)
OS Image Description os_1
Tuning

  • cpupower -c all frequency-set -g performance
  • tuned-adm profile throughput-performance

  • echo 960000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 40000000 > /proc/sys/kernel/sched_latency_ns
  • echo 40000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 900000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 200000000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 9000 > /proc/sys/kernel/sched_nr_migrate
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo 0 > /proc/sys/vm/numa_stat
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag

  • ulimit -n 1024000
  • UserTasksMax=970000
  • DefaultTasksMax=970000

Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-Xms30g -Xmx30g -Xmn29g -XX:AllocatePrefetchInstr=2 -XX:+UseParallelGC -XX:ParallelGCThreads=16 -XX:LargePageSizeInBytes=2m -XX:-UseAdaptiveSizePolicy -XX:+AlwaysPreTouch -XX:+UseLargePages -XX:SurvivorRatio=20 -XX:TargetSurvivorRatio=95 -XX:MaxTenuringThreshold=15 -XX:InlineSmallCode=11k -XX:MaxGCPauseMillis=100 -XX:LoopUnrollLimit=200 -XX:+UseTransparentHugePages -XX:ThreadStackSize=140 -XX:CompileThresholdScaling=120 -XX:CICompilerCount=4

Tuning

Used numactl to affinitize each Backend JVM to 8 Core / 16 Threads

  • Group1: --physcpubind=0-7,96-103 --localalloc
  • Group2: --physcpubind=8-15,104-111 --localalloc
  • Group3: --physcpubind=16-23,112-119 --localalloc
  • Group4: --physcpubind=24-31,120-127 --localalloc
  • Group5: --physcpubind=32-39,128-135 --localalloc
  • Group6: --physcpubind=40-47,136-143 --localalloc
  • Group7: --physcpubind=48-55,144-151 --localalloc
  • Group8: --physcpubind=56-63,152-159 --localalloc
  • Group9: --physcpubind=64-71,160-167 --localalloc
  • Group10: --physcpubind=72-79,168-175 --localalloc
  • Group11: --physcpubind=80-87,176-183 --localalloc
  • Group12: --physcpubind=88-95,184-191 --localalloc

Notes None
Hardware
OS Images os_Image_2(1)
Hardware Description hw_2
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • NUMA nodes per socket = NPS2
  • Determinism Control = Manual
  • Determinism Slider = Power
  • cTDP Control = Manual
  • cTDP = 240
  • Package Power Limit Control = Manual
  • Package Power Limit = 240
  • L1 Stream HW Prefetcher = Disable
  • L2 Stream HW Prefetcher = Disable

Notes None
OS Image os_Image_2
JVM Instances jvm_Ctr_1(1), jvm_TxInjector_1(12)
OS Image Description os_2
Tuning

  • cpupower -c all frequency-set -g performance
  • tuned-adm profile throughput-performance

  • echo 960000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 40000000 > /proc/sys/kernel/sched_latency_ns
  • echo 40000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 900000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 200000000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 9000 > /proc/sys/kernel/sched_nr_migrate
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo 0 > /proc/sys/vm/numa_stat
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag

Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_2
Command Line

-Xms10g -Xmx10g -Xmn8g -XX:+UseParallelGC -XX:CICompilerCount=2 -XX:ParallelGCThreads=4

Tuning

Used numactl to interleave memory on all Nodes in Driver system

  • numactl --interleave=all

Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_1
Command Line

-Xms3g -Xmx3g -Xmn2g -XX:+UseParallelGC -XX:CICompilerCount=4 -XX:ParallelGCThreads=2

Tuning

Used numactl to affinitize 6 Transaction Injector JVM to one NUMA node in Driver system

  • Group1:numactl --cpunodebind=0 --membind=0
  • Group2:numactl --cpunodebind=0 --membind=0
  • Group3:numactl --cpunodebind=0 --membind=0
  • Group4:numactl --cpunodebind=0 --membind=0
  • Group5:numactl --cpunodebind=0 --membind=0
  • Group6:numactl --cpunodebind=0 --membind=0
  • Group7:numactl --cpunodebind=1 --membind=1
  • Group8:numactl --cpunodebind=1 --membind=1
  • Group9:numactl --cpunodebind=1 --membind=1
  • Group10:numactl --cpunodebind=1 --membind=1
  • Group11:numactl --cpunodebind=1 --membind=1
  • Group12:numactl --cpunodebind=1 --membind=1

Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Pass Fail Fail
jOPS 384871 389805 394739 399673 404608
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 160363 189968 224508 259047 288653 219662
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 4934 / 9868 - / 4934 - / 4934 - / 4934 - / 4934 - / 4934
1000us 157896 / 162830 9868 / 14803 4934 / 9868 4934 / 9868 - / 4934 - / 4934
5000us 375002 / 379936 315791 / 320726 167764 / 172698 138159 / 143093 98685 / 103619 - / 4934
10000us 379936 / 384871 350331 / 355265 276317 / 281252 246712 / 251646 157896 / 162830 - / 4934
25000us 379936 / 384871 365134 / 370068 320726 / 325660 296054 / 300989 187501 / 192435 14803 / 4934
50000us 384871 / 389805 370068 / 375002 330594 / 335528 315791 / 320726 222041 / 226975 14803 / 4934
75000us 384871 / 389805 375002 / 379936 340463 / 345397 325660 / 330594 256580 / 261515 14803 / 4934
100000us 389805 / 394739 375002 / 379936 340463 / 345397 330594 / 335528 286186 / 291120 83882 / 4934
200000us 394739 / - 379936 / 384871 360200 / 365134 345397 / 350331 330594 / 335528 192435 / 24671
500000us 394739 / - 389805 / 394739 379936 / 384871 350331 / 355265 345397 / 350331 320726 / 44408
1000000us 394739 / - 394739 / - 389805 / 394739 355265 / 360200 350331 / 355265 350331 / 44408
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller Group1.Backend.beJVM Group1.TxInjector.txiJVM1 Group10.Backend.beJVM Group10.TxInjector.txiJVM1 Group11.Backend.beJVM Group11.TxInjector.txiJVM1 Group12.Backend.beJVM Group12.TxInjector.txiJVM1 Group2.Backend.beJVM Group2.TxInjector.txiJVM1 Group3.Backend.beJVM Group3.TxInjector.txiJVM1 Group4.Backend.beJVM Group4.TxInjector.txiJVM1 Group5.Backend.beJVM Group5.TxInjector.txiJVM1 Group6.Backend.beJVM Group6.TxInjector.txiJVM1 Group7.Backend.beJVM Group7.TxInjector.txiJVM1 Group8.Backend.beJVM Group8.TxInjector.txiJVM1 Group9.Backend.beJVM Group9.TxInjector.txiJVM1
specjbb.comm.connect.client.pool.size 256 256 200 150 200 150 200 150 200 150 200 150 200 150 200 150 200 150 200 150 200 150 200 150 200 150
specjbb.comm.connect.selector.runner.count 0 2 4 4 4 4 4 4 4 4 4 4 4 4
specjbb.comm.connect.timeouts.connect 60000 900000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000
specjbb.comm.connect.timeouts.read 60000 800000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000
specjbb.comm.connect.timeouts.write 60000 800000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000
specjbb.comm.connect.worker.pool.max 256 256 200 150 200 150 200 150 200 150 200 150 200 150 200 150 200 150 200 150 200 150 200 150 200 150
specjbb.comm.connect.worker.pool.min 1 1 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16
specjbb.controller.host localhost 192.168.42.21
specjbb.controller.maxir.maxFailedPoints 3 1
specjbb.customerDriver.threads 64 {probe=90, saturate=140, service=90}
specjbb.forkjoin.workers 128 {Tier1=130, Tier2=6, Tier3=17}
specjbb.group.count 1 12
specjbb.heartbeat.period 10000 400000
specjbb.heartbeat.threshold 100000 4000000
specjbb.mapreducer.pool.size 128 6
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 493424 IR
High-bound (settled) is 422086 IR