SPECjbb2015 Report for jbb2015-20240130-01223 : 123416 max-jOPS ; 64136 critical-jOPS

SUT Description

Hardware hw_1
Name	SuperServer SYS-521C-NR
Vendor	Supermicro
Vendor URL	https://www.supermicro.com
Available	Dec-2023
Model	X13SEDW-F
Form Factor	2U
CPU Name	Intel Xeon Gold 5520+
CPU Characteristics	28 Core, 2.20 GHz, 52.5 MB L3 Cache (Turbo Boost Technology up to 4.00 GHz)
Number of Systems	1
Nodes Per System	1
Chips Per System	1
Cores Per System	28
Cores Per Chip	28
Threads Per System	56
Threads Per Core	2
Version	2.1 12/06/2023
CPU Frequency (MHz)	2200
Primary Cache	32 KB(I) + 48 KB(D) per core
Secondary Cache	2 MB (I+D) per core
Tertiary Cache	52.5 MB (I+D) on chip per chip
Other Cache	None
Disk	1 x 480 GB M.2 NVMe SSD
File System	xfs
Memory Amount (GB)	512
# and size of DIMM(s)	8 x 64 GB
Memory Details	64 GB 2Rx4 PC5-4800B-R
# and type of Network Interface Cards (NICs)	2 x 10 Gbit NICs
Power Supply Quantity and Rating (W)	1 x 1200W
Other Hardware	None
Cabinet/Housing/Enclosure	None
Shared Description	None
Shared Comment	None
Notes	NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented. Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented. Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
Name	None
Vendor	None
Vendor URL	None
Version	None
Available	None
Bitness	None
Notes	None

Operating System os_1
Name	SUSE Linux Enterprise Server 15 SP4
Vendor	SUSE
Vendor URL	https://www.suse.com/
Version	5.14.21-150400.22-default
Available	Jun-2022
Bitness	64
Notes	None
Java Virtual Machine jvm_1
Name	Oracle Java SE 17.0.9
Vendor	Oracle
Vendor URL	http://www.oracle.com/
Version	Java HotSpot 64-bit Server VM, version 17.0.9
Available	Oct-2023
Bitness	64
Notes	None
Other Software other_1
Name	None
Vendor	None
Vendor URL	None
Version	None
Available	None
Bitness	None
Notes	None

Topology

SUT
- Hardware config_1
  - OS Image os_Image_1
    - JVM jvm_Ctr_1 : Controller
    - JVM jvm_Backend_1 : Backend
    - JVM jvm_TxInjector_1 : TxInjector

SUT config_1 Configuration

Hardware
OS Images	os_Image_1(1)
Hardware Description	hw_1
Number of Systems	1
SW Environment	non-virtual
Tuning	BIOS Settings: Intel HT Technology=Enable Turbo Mode=Enable SNC=SNC2 Enable Power Technology=Custom Power Performance Tuning=BIOS Controls EPB ENERGY_PERF_BIAS_CFG mode=Maximum Performance
Notes	None

OS Image os_Image_1
JVM Instances	jvm_Ctr_1(1), jvm_Backend_1(4), jvm_TxInjector_1(4)
OS Image Description	os_1
Tuning	tuned-adm profile throughput-performance ulimit -n 1024000 echo 10000 > /proc/sys/kernel/sched_cfs_bandwidth_slice_us echo 0 > /proc/sys/kernel/sched_child_runs_first echo 56000000 > /sys/kernel/debug/sched/latency_ns echo 1000 > /sys/kernel/debug/sched/migration_cost_ns echo 16000000 > /sys/kernel/debug/sched/min_granularity_ns echo 9 > /sys/kernel/debug/sched/nr_migrate echo 100 > /proc/sys/kernel/sched_rr_timeslice_ms echo 1000000 > /proc/sys/kernel/sched_rt_period_us echo 990000 > /proc/sys/kernel/sched_rt_runtime_us echo 0 > /proc/sys/kernel/sched_schedstats echo 1 > /sys/kernel/debug/sched/tunable_scaling echo 50000000 > /sys/kernel/debug/sched/wakeup_granularity_ns echo 3000 > /proc/sys/vm/dirty_expire_centisecs echo 500 > /proc/sys/vm/dirty_writeback_centisecs echo 40 > /proc/sys/vm/dirty_ratio echo 10 > /proc/sys/vm/dirty_background_ratio echo 10 > /proc/sys/vm/swappiness echo 0 > /proc/sys/kernel/numa_balancing echo always > /sys/kernel/mm/transparent_hugepage/defrag echo always > /sys/kernel/mm/transparent_hugepage/enabled ulimit -v 800000000 ulimit -m 800000000 ulimit -l 800000000 echo 300 > /sys/kernel/mm/hugepages/hugepages-1048576kB/nr_hugepages echo 8000 > /sys/kernel/mm/hugepages/hugepages-2048kb/nr_hugepages systemctl stop systemed-update-utmp-runlevel.service echo 274877906944 > /proc/sys/kernel/shmmax echo 274877906944 > /proc/sys/kernel/shmall
Notes	None
JVM Instance jvm_Ctr_1
Parts of Benchmark	Controller
JVM Instance Description	jvm_1
Command Line	-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=1G -XX:+UseParallelGC -XX:ParallelGCThreads=2
Tuning	Used numactl to interleave memory on all CPUs numactl --interleave=all
Notes	None
JVM Instance jvm_Backend_1
Parts of Benchmark	Backend
JVM Instance Description	jvm_1
Command Line	-XX:+UseParallelGC -XX:+UseLargePages -XX:+AlwaysPreTouch -XX:-UseAdaptiveSizePolicy -XX:MaxTenuringThreshold=15 -XX:InlineSmallCode=10k -verbose:gc -XX:-UseCountedLoopSafepoints -XX:LoopUnrollLimit=20 -server -XX:TargetSurvivorRatio=95 -XX:SurvivorRatio=14 -XX:LargePageSizeInBytes=1G -XX:MaxGCPauseMillis=500 -XX:AdaptiveSizeMajorGCDecayTimeScale=12 -XX:AdaptiveSizeDecrementScaleFactor=2 -XX:AllocatePrefetchLines=3 -XX:AllocateInstancePrefetchLines=2 -XX:AllocatePrefetchStepSize=128 -XX:AllocatePrefetchDistance=384 -Xms29g -Xmx29g -Xmn27g -XX:UseAVX=0 -XX:ParallelGCThreads=14 -XX:+UseHugeTLBFS
Tuning	Used numactl to affinitize each Backend JVM to physical cores in a NUMA node. Group1: numactl --physcpubind=0-6,28-34 --localalloc Group2: numactl --physcpubind=7-13,35-41 --localalloc Group3: numactl --physcpubind=14-20,42-48 --localalloc Group4: numactl --physcpubind=21-27,49-55 --localalloc
Notes	None
JVM Instance jvm_TxInjector_1
Parts of Benchmark	TxInjector
JVM Instance Description	jvm_1
Command Line	-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=1G -XX:+UseParallelGC -XX:ParallelGCThreads=2
Tuning	Used numactl to affinitize each Injector JVM to physical cores in a NUMA node. Group1: numactl --physcpubind=0-6,28-34 --localalloc Group2: numactl --physcpubind=7-13,35-41 --localalloc Group3: numactl --physcpubind=14-20,42-48 --localalloc Group4: numactl --physcpubind=21-27,49-55 --localalloc
Notes	None

max-jOPS and critical-jOPS Details

max-jOPS = jOPS passed before the First Failure
Pass/Fail	Pass	Pass	Fail	Fail	Fail
jOPS	122045	123416	124787	126159	127530

critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us)	10000	25000	50000	75000	100000	Geomean
jOPS	43195	54166	66507	78849	88448	64136

Last Success jOPS/First Failure jOPS for SLA points

	Percentile
	10-th	50-th	90-th	95-th	99-th	100-th
500us	2743 / 4114	1371 / 2743	1371 / 2743	- / 1371	- / 1371	- / 1371
1000us	19198 / 20569	5485 / 6856	4114 / 5485	4114 / 5485	2743 / 4114	- / 1371
5000us	108332 / 109703	94619 / 95990	31540 / 32911	26055 / 27426	23312 / 24683	2743 / 4114
10000us	109703 / 111074	102847 / 104218	83649 / 85020	69936 / 71307	42510 / 43881	5485 / 4114
25000us	111074 / 112446	106961 / 108332	95990 / 97362	90505 / 91876	53480 / 54852	5485 / 4114
50000us	112446 / 113817	108332 / 109703	101475 / 102847	95990 / 97362	65822 / 67193	5485 / 4114
75000us	112446 / 113817	109703 / 111074	102847 / 104218	97362 / 98733	79535 / 78164	5485 / 4114
100000us	115188 / 116560	109703 / 111074	104218 / 105589	101475 / 102847	87763 / 89134	32911 / 4114
200000us	116560 / 117931	112446 / 113817	108332 / 109703	108332 / 109703	104218 / 105589	86391 / 15084
500000us	123416 / -	117931 / 119302	115188 / 116560	113817 / 115188	112446 / 113817	109703 / 108332
1000000us	123416 / -	123416 / -	122045 / 123416	119302 / 120674	119302 / 120674	115188 / 116560

Number of probes

Request Mix Accuracy

Note

(Actual % in the Mix - Expected % in the Mix) must be within:

'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%

'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%

Rate of Non-Critical Failures

There were no non-critical failures in Response Time curve building

Delay between performance status pings during RT Curve (Response-Throughput Curve)

IR/PR Accuracy

Run Properties

This section lists properties only set by user

Property Name	Default	Controller
specjbb.comm.connect.client.pool.size	256	256
specjbb.comm.connect.selector.runner.count	0	0
specjbb.comm.connect.timeouts.connect	60000	60000
specjbb.comm.connect.timeouts.read	60000	60000
specjbb.comm.connect.timeouts.write	60000	60000
specjbb.comm.connect.worker.pool.max	256	256
specjbb.comm.connect.worker.pool.min	1	1
specjbb.controller.host	localhost	localhost
specjbb.controller.port	24000	24000
specjbb.controller.type	HBIR_RT	HBIR_RT
specjbb.customerDriver.threads	64	{=75, probe=69, saturate=85}
specjbb.forkjoin.workers	56	{Tier1=70, Tier2=3, Tier3=14}
specjbb.group.count	1	4
specjbb.heartbeat.period	10000	40000
specjbb.heartbeat.threshold	100000	400000
specjbb.mapreducer.pool.size	56	223
specjbb.txi.pergroup.count	1	1

View table in csv format

Validation Details

Validation Reports


Level: COMPLIANCE
Check	Agent	Result
Check properties on compliance	All	PASSED


Level: CORRECTNESS
Check	Agent	Result
Compare SM and HQ Inventory	All	PASSED

Other Checks

High-bound (max attempted) is 137129 IR

High-bound (settled) is 132743 IR

http://www.spec.org - info@spec.org

SPECjbb2015 Version: [SPECjbb2015 1.03, Nov 14, 2019]

Supermicro SuperServer SYS-521C-NR	123416 SPECjbb2015-MultiJVM max-jOPS 64136 SPECjbb2015-MultiJVM critical-jOPS
Tested by: Supermicro	Test Sponsor: Supermicro	Test location: San Jose, California	Test date: Jan 25, 2024
SPEC license #: 001176	Hardware Availability: Dec-2023	Software Availability: Dec-2023	Publication: Fri Feb 23 11:38:52 EST 2024


SPECjbb2015-MultiJVM: Multiple JVMs/Single Host (# of groups: 4) Overall SUT Description SUT Description max-jOPS and critical-jOPS Details Number of probes Request Mix Accuracy Rate Of Non-Critical Failures Delay between performance status pings IR/PR Accuracy Topology SUT Configuration Properties Validation Details Link to Full Disclosure	Overall Throughput RT curve