Copyright © 2018 Standard Performance Evaluation Corporation |
Cloud Vendor: Inspur
Cloud Type / SUT Type: private/whitebox Hardware Platform: CS5260F Hypervisor: KVM Cloud Infrastructure: ICP 3.5 |
Replicated Application Instances: 147 copies
Performance Score: 49.3 Relative Scalability: 87.6% Mean Instance Provisioning Time: 45s |
Tested by: Inspur | SPEC Licence Number : 3358 | Test Date : Apr 18, 2022 |
Performance Sections
Performance Summary Performance Details Validation, Errors, and Issues Glossary of Terms |
SUT Configuration Sections
Instance Configuration Cloud Configuration Network Configuration Storage Configuration |
Scale-out Phase Date/Time and Test Region
Scale-out Start Time: 2022-04-18_13:30:44_UTC Scale-out End Time: 2022-04-18_22:36:41_UTC Test Region: CN Central Standard Time |
Cloud Informational Metrics
AI Provisioning Success: 97.35% AI Run Success: 99.32 Total Instances: 955 |
Baseline Summary Results for YCSB | ||||
---|---|---|---|---|
Throughput (ops/s) | Insert Latency 99% (ms) | Read Latency 99% (ms) | AI Provisioning Time (s) | |
Average | 8937.9 | 12.765 | 17.311 | 199.6 |
Baseline Summary Results for KMeans | ||
---|---|---|
Completion Time (s) | AI Provisioning Time (s) | |
Average | 285.08 | 187.0 |
Scale-out Summary Results for YCSB for 73 Valid AIs | |||||
---|---|---|---|---|---|
Av. Throughput (ops/s) | Av. Insert Latency 99% (ms) | Av. Read Latency 99% (ms) | Av. Provisioning Time (s) | Performance Score | Relative Scalability (%) |
7597.6 | 17.428 | 23.433 | 204.8 | 16.58 | 83.82 |
Scale-out Summary Results for KMeans for 74 Valid AIs | |||
---|---|---|---|
Av. Completion Time (s) | Av. Provisioning Time (s) | Performance Score | Relative Scalability (%) |
320.5 | 189.3 | 32.72 | 91.44 |
YCSB Summary Results by AI | |||||||
---|---|---|---|---|---|---|---|
AI name | Run count | Run codes | Av. Throughput (ops/s) | Av. Insert Latency 99% (ms) | Av. Read Latency 99% (ms) | AI. Provisioning time (s) | AI. Prov. Initiated from Scale-out Start (s) |
ai_1 | 37 | 0 | 8205.0 | 14.392 | 19.025 | 204.0 | 5.0 |
ai_4 | 40 | 0 | 9165.6 | 14.576 | 20.071 | 197.0 | 495.0 |
ai_6 | 33 | 0 | 7580.3 | 15.998 | 22.870 | 201.0 | 964.0 |
ai_7 | 34 | 0 | 7892.0 | 14.239 | 19.004 | 205.0 | 1367.0 |
ai_10 | 38 | 0 | 9210.5 | 14.099 | 19.788 | 202.0 | 1855.0 |
ai_12 | 34 | 0 | 8163.1 | 13.959 | 19.069 | 203.0 | 2413.0 |
ai_14 | 33 | 0 | 8017.8 | 14.082 | 18.560 | 207.0 | 2836.0 |
ai_16 | 36 | 0 | 9164.6 | 14.184 | 19.816 | 194.0 | 3283.0 |
ai_18 | 32 | 0 | 7885.4 | 15.564 | 22.614 | 197.0 | 3622.0 |
ai_19 | 32 | 0 | 8109.6 | 13.997 | 18.944 | 199.0 | 4034.0 |
ai_21 | 34 | 0 | 8894.9 | 14.876 | 20.670 | 207.0 | 4489.0 |
ai_24 | 30 | 0 | 7868.8 | 16.070 | 22.858 | 202.0 | 5062.0 |
ai_26 | 31 | 0 | 8205.9 | 14.497 | 19.997 | 197.0 | 5475.0 |
ai_29 | 28 | 0 | 7796.3 | 16.887 | 22.156 | 201.0 | 6004.0 |
ai_30 | 13 | 0 | 3421.1 | 31.267 | 35.181 | 213.0 | 6386.0 |
ai_32 | 31 | 0 | 8761.9 | 14.372 | 20.545 | 205.0 | 6894.0 |
ai_34 | 30 | 0 | 8564.0 | 14.530 | 21.522 | 201.0 | 7249.0 |
ai_36 | 26 | 0 | 7707.6 | 16.250 | 23.529 | 212.0 | 7699.0 |
ai_38 | 20 | 0 | 6154.4 | 23.792 | 29.853 | 205.0 | 8031.0 |
ai_41 | 26 | 0 | 8220.2 | 16.171 | 20.997 | 201.0 | 8562.0 |
ai_42 | 13 | 0 | 3881.4 | 25.709 | 30.923 | 208.0 | 8915.0 |
ai_44 | 25 | 0 | 8039.9 | 14.586 | 20.030 | 200.0 | 9513.0 |
ai_46 | 26 | 0 | 8497.7 | 15.849 | 21.578 | 209.0 | 9880.0 |
ai_48 | 23 | 0 | 7420.1 | 16.804 | 23.699 | 213.0 | 10203.0 |
ai_50 | 23 | 0 | 7612.0 | 14.760 | 19.644 | 193.0 | 10552.0 |
ai_52 | 23 | 0 | 8008.1 | 15.547 | 21.391 | 200.0 | 10949.0 |
ai_53 | 22 | 0 | 7435.8 | 14.540 | 20.175 | 202.0 | 11365.0 |
ai_55 | 27 | 0 | 9568.9 | 13.109 | 18.276 | 220.0 | 11913.0 |
ai_58 | 24 | 0 | 9046.8 | 14.998 | 21.318 | 197.0 | 12457.0 |
ai_60 | 20 | 0 | 7501.3 | 16.850 | 23.565 | 202.0 | 12844.0 |
ai_61 | 16 | 0 | 5617.5 | 17.232 | 22.074 | 203.0 | 13148.0 |
ai_63 | 21 | 0 | 8263.1 | 15.921 | 22.008 | 203.0 | 13671.0 |
ai_66 | 20 | 0 | 7918.8 | 15.865 | 23.023 | 208.0 | 14224.0 |
ai_68 | 20 | 0 | 8005.0 | 15.273 | 20.797 | 206.0 | 14578.0 |
ai_70 | 21 | 0 | 9106.2 | 14.538 | 20.300 | 202.0 | 14904.0 |
ai_72 | 18 | 0 | 7453.8 | 16.931 | 24.319 | 207.0 | 15331.0 |
ai_74 | 18 | 0 | 7874.1 | 15.008 | 20.989 | 204.0 | 15651.0 |
ai_76 | 19 | 0 | 8395.9 | 16.750 | 23.154 | 209.0 | 16057.0 |
ai_78 | 8 | 0 | 3468.6 | 30.225 | 36.091 | 206.0 | 16432.0 |
ai_80 | 17 | 0 | 7776.3 | 15.587 | 21.030 | 197.0 | 16769.0 |
ai_82 | 8 | 0 | 3682.0 | 34.153 | 39.133 | 197.0 | 17241.0 |
ai_83 | 15 | 0 | 7574.8 | 15.932 | 22.666 | 209.0 | 17643.0 |
ai_85 | 16 | 0 | 7917.3 | 15.261 | 21.089 | 208.0 | 18073.0 |
ai_88 | 15 | 0 | 7819.7 | 17.026 | 22.741 | 209.0 | 18662.0 |
ai_90 | 15 | 0 | 7950.0 | 15.673 | 22.424 | 203.0 | 19027.0 |
ai_92 | 14 | 0 | 7851.5 | 14.597 | 19.777 | 204.0 | 19389.0 |
ai_94 | 15 | 0 | 9081.2 | 13.904 | 19.109 | 204.0 | 19852.0 |
ai_95 | 12 | 0 | 7489.4 | 15.898 | 22.451 | 220.0 | 20205.0 |
ai_97 | 13 | 0 | 8057.4 | 14.033 | 19.096 | 204.0 | 20643.0 |
ai_99 | 13 | 0 | 8717.5 | 15.064 | 20.886 | 206.0 | 21241.0 |
ai_101 | 12 | 0 | 7985.8 | 15.884 | 22.663 | 199.0 | 21551.0 |
ai_103 | 12 | 0 | 8155.4 | 14.206 | 19.667 | 205.0 | 21926.0 |
ai_105 | 12 | 0 | 8732.2 | 14.786 | 20.803 | 219.0 | 22344.0 |
ai_107 | 10 | 0 | 7752.4 | 15.049 | 20.741 | 216.0 | 22736.0 |
ai_109 | 10 | 0 | 8260.0 | 14.381 | 19.601 | 207.0 | 23202.0 |
ai_111 | 4 | 0 | 4090.8 | 31.443 | 36.531 | 197.0 | 23570.0 |
ai_113 | 9 | 0 | 8118.4 | 14.920 | 21.087 | 199.0 | 24019.0 |
ai_115 | 8 | 0 | 7855.0 | 15.589 | 21.401 | 198.0 | 24575.0 |
ai_117 | 8 | 0 | 8188.8 | 17.031 | 23.201 | 207.0 | 25094.0 |
ai_119 | 2 | 1 | 1855.0 | 60.207 | 63.727 | 214.0 | 25541.0 |
ai_122 | 6 | 0 | 7782.6 | 14.911 | 20.554 | 202.0 | 26109.0 |
ai_124 | 7 | 0 | 8593.8 | 15.300 | 21.169 | 209.0 | 26505.0 |
ai_125 | 5 | 0 | 7050.4 | 17.874 | 24.604 | 219.0 | 26906.0 |
ai_127 | 6 | 0 | 8220.0 | 14.326 | 20.266 | 200.0 | 27320.0 |
ai_129 | 5 | 0 | 9077.9 | 15.337 | 21.471 | 203.0 | 27786.0 |
ai_131 | 4 | 0 | 7527.7 | 17.095 | 25.135 | 210.0 | 28381.0 |
ai_133 | 3 | 0 | 5996.1 | 20.106 | 26.895 | 208.0 | 28814.0 |
ai_135 | 4 | 0 | 8998.1 | 15.135 | 21.967 | 203.0 | 29306.0 |
ai_137 | 3 | 0 | 7712.1 | 15.687 | 22.468 | 206.0 | 29619.0 |
ai_140 | 2 | 0 | 6923.0 | 18.503 | 26.895 | 207.0 | 30076.0 |
ai_141 | 1 | 0 | 4638.7 | 26.015 | 32.799 | 208.0 | 30518.0 |
ai_144 | 1 | 0 | 7178.4 | 19.551 | 31.103 | 209.0 | 31108.0 |
ai_146 | 1 | 0 | 7910.5 | 17.503 | 25.055 | 202.0 | 31639.0 |
ai_148 | 0 | 3 | 0.0 | 0.000 | 0.000 | 53.0 | 32061.0 |
ai_150 | 0 | 3 | 0.0 | 0.000 | 0.000 | 53.0 | 32419.0 |
KMeans Summary Results by AI | |||||
---|---|---|---|---|---|
AI name | Run count | Run code | Av. Completion Time (s) | Av. Provisioning time (s) | AI. Prov. Initiated from Scale-out Start (s) |
ai_2 | 78 | 0 | 326.62 | 182.0 | 14.0 |
ai_3 | 84 | 0 | 293.89 | 179.0 | 354.0 |
ai_5 | 75 | 0 | 325.61 | 202.0 | 870.0 |
ai_8 | 78 | 0 | 307.64 | 177.0 | 1464.0 |
ai_9 | 78 | 0 | 306.28 | 177.0 | 1853.0 |
ai_11 | 71 | 0 | 325.30 | 192.0 | 2182.0 |
ai_13 | 79 | 0 | 288.61 | 185.0 | 2680.0 |
ai_15 | 67 | 0 | 342.48 | 193.0 | 3193.0 |
ai_17 | 68 | 0 | 327.24 | 200.0 | 3554.0 |
ai_20 | 68 | 0 | 326.16 | 180.0 | 4052.0 |
ai_22 | 67 | 0 | 317.67 | 189.0 | 4508.0 |
ai_23 | 63 | 0 | 338.17 | 174.0 | 4935.0 |
ai_25 | 68 | 0 | 310.62 | 178.0 | 5247.0 |
ai_27 | 62 | 0 | 336.29 | 183.0 | 5585.0 |
ai_28 | 63 | 0 | 327.24 | 180.0 | 5908.0 |
ai_31 | 58 | 0 | 341.47 | 182.0 | 6392.0 |
ai_33 | 57 | 0 | 346.77 | 187.0 | 6895.0 |
ai_35 | 59 | 0 | 319.86 | 194.0 | 7443.0 |
ai_37 | 61 | 0 | 311.98 | 190.0 | 7752.0 |
ai_39 | 63 | 0 | 294.59 | 165.0 | 8176.0 |
ai_40 | 61 | 0 | 303.69 | 229.0 | 8520.0 |
ai_43 | 60 | 0 | 297.15 | 175.0 | 9100.0 |
ai_45 | 53 | 0 | 337.60 | 194.0 | 9623.0 |
ai_47 | 51 | 0 | 335.80 | 194.0 | 9958.0 |
ai_49 | 57 | 0 | 293.86 | 188.0 | 10501.0 |
ai_51 | 52 | 0 | 319.08 | 189.0 | 10858.0 |
ai_54 | 54 | 0 | 304.74 | 180.0 | 11422.0 |
ai_56 | 47 | 0 | 332.55 | 191.0 | 11920.0 |
ai_57 | 45 | 0 | 349.82 | 175.0 | 12396.0 |
ai_59 | 48 | 0 | 312.42 | 202.0 | 12798.0 |
ai_62 | 44 | 0 | 337.52 | 173.0 | 13216.0 |
ai_64 | 42 | 0 | 348.74 | 232.0 | 13683.0 |
ai_65 | 47 | 0 | 296.11 | 210.0 | 14003.0 |
ai_67 | 42 | 0 | 339.12 | 181.0 | 14439.0 |
ai_69 | 43 | 0 | 312.88 | 193.0 | 14762.0 |
ai_71 | 39 | 0 | 340.36 | 184.0 | 15129.0 |
ai_73 | 42 | 0 | 321.10 | 177.0 | 15437.0 |
ai_75 | 40 | 0 | 316.57 | 188.0 | 15885.0 |
ai_77 | 39 | 0 | 316.10 | 187.0 | 16402.0 |
ai_79 | 37 | 0 | 333.89 | 181.0 | 16703.0 |
ai_81 | 36 | 0 | 319.19 | 201.0 | 17221.0 |
ai_84 | 38 | 0 | 293.34 | 177.0 | 17755.0 |
ai_86 | 32 | 0 | 352.72 | 183.0 | 18132.0 |
ai_87 | 32 | 0 | 342.91 | 189.0 | 18504.0 |
ai_89 | 30 | 0 | 337.70 | 210.0 | 19019.0 |
ai_91 | 33 | 0 | 313.94 | 179.0 | 19376.0 |
ai_93 | 29 | 0 | 341.86 | 176.0 | 19804.0 |
ai_96 | 29 | 0 | 324.45 | 179.0 | 20284.0 |
ai_98 | 29 | 0 | 312.24 | 195.0 | 20828.0 |
ai_100 | 28 | 0 | 299.39 | 231.0 | 21287.0 |
ai_102 | 28 | 0 | 296.14 | 179.0 | 21625.0 |
ai_104 | 26 | 0 | 307.00 | 189.0 | 22178.0 |
ai_106 | 22 | 0 | 339.59 | 194.0 | 22670.0 |
ai_108 | 23 | 0 | 317.61 | 185.0 | 22990.0 |
ai_110 | 23 | 0 | 304.13 | 180.0 | 23311.0 |
ai_112 | 18 | 0 | 352.06 | 203.0 | 23805.0 |
ai_114 | 18 | 0 | 343.94 | 188.0 | 24396.0 |
ai_116 | 17 | 0 | 360.47 | 191.0 | 24714.0 |
ai_118 | 16 | 0 | 335.19 | 209.0 | 25204.0 |
ai_120 | 17 | 0 | 314.76 | 180.0 | 25643.0 |
ai_121 | 16 | 0 | 307.19 | 184.0 | 26092.0 |
ai_123 | 16 | 0 | 296.00 | 188.0 | 26400.0 |
ai_126 | 14 | 0 | 303.21 | 231.0 | 26948.0 |
ai_128 | 12 | 0 | 313.83 | 181.0 | 27380.0 |
ai_130 | 10 | 0 | 309.80 | 200.0 | 27974.0 |
ai_132 | 9 | 0 | 344.78 | 187.0 | 28390.0 |
ai_134 | 7 | 0 | 372.71 | 181.0 | 28987.0 |
ai_136 | 8 | 0 | 262.62 | 174.0 | 29328.0 |
ai_138 | 6 | 0 | 316.17 | 221.0 | 29682.0 |
ai_139 | 5 | 0 | 386.20 | 190.0 | 30036.0 |
ai_142 | 4 | 0 | 357.75 | 182.0 | 30529.0 |
ai_143 | 4 | 0 | 317.00 | 180.0 | 30866.0 |
ai_145 | 4 | 0 | 243.25 | 181.0 | 31226.0 |
ai_147 | 1 | 0 | 215.00 | 197.0 | 31821.0 |
ai_149 | 0 | 3 | 0 | 55.0 | 32195.0 |
ai_151 | 0 | 3 | 0 | 52.0 | 32613.0 |
Instance Configuration Hadoop Master | |
---|---|
Parameter | Value |
instance_type_name | medium |
cpu | 4 |
memory | 4GB |
disk_size | 40GB |
disk_backed | block storage |
image_name | hadoop_spec_6 |
Notes | none |
Instance Configuration Hadoop Slave | |
---|---|
Parameter | Value |
instance_type_name | medium |
cpu | 4 |
memory | 4GB |
disk_size | 40GB |
disk_backed | block storage |
image_name | hadoop_spec_6 |
Notes | none |
Instance Configuration YCSB | |
---|---|
Parameter | Value |
instance_type_name | medium |
cpu | 4 |
memory | 4GB |
disk_size | 40GB |
disk_backed | block storage |
image_name | cassandra_spec_5 |
Notes | none |
Instance Configuration Cassandra | |
---|---|
Parameter | Value |
instance_type_name | medium |
cpu | 4 |
memory | 4GB |
disk_size | 40GB |
disk_backed | block storage |
image_name | cassandra_spec_5 |
Notes | none |
Cloud High Level Information and Availability | |
---|---|
Parameter | Value |
Name | Inspur Cloud Platform |
Type | private |
Sut_Type | whitebox |
Virtualized | KVM |
Manager_Protocol | ICP |
Manager_Version | 3.5 |
Hardware_Availability | Jun-2021 |
Software/Service_Availability | Apr-2018 |
Geographic_Distribution | 1 |
Notes | none |
Cloud Under Test Software Levels | |
---|---|
Parameter | Value |
Python_version | 2.7.12 |
JVM_version | 1.8.0_242 |
Hadoop_version | 2.7.5 |
Cassandra_version | 2.1.20 |
Notes | none |
Benchmark Harness Node | |
---|---|
Parameter | Value |
Vendor | Inspur |
Platform | NF5280M5 |
CPU_Description | Intel(R) Xeon(R) Platinum 8260 CPU @ 2.40GHz |
CPU_Frequency_MHz | 3100 |
RAM_Memory | 376 GB, ECC, DDR4, 2933MHz RDIMM |
Local_Storage | 2*240GB SSD,1*1.92TB SSD |
Quantity | 1 |
Availability_Date | Apr-2019 |
OS_Version | Ubuntu 18.04.5 LTS |
OS_Availability_Date | Aug-2020 |
Network_Adapter_1 | Intel Corporation Ethernet Controller X710 for 10GbE SFP+ |
Network_Adapter_2 | Intel Corporation I350 Gigabit Network Connection |
Network_port_type_1 | 10GBASE-SR |
Network_port_type_2 | 1000BASE-T |
Network_speed_port_1 | 10 Gb/s |
Network_speed_port_2 | 1000 Mb/s |
Notes | none |
Cloud Manager Node | |
---|---|
Parameter | Value |
Hw_Vendor | Inspur |
Hw_Platform | CS5260F |
CPU_Type | Phytium,S2500/64 |
CPU_Count | 2 |
CPU_Cores_Per | 64 |
CPU_Frequency_MHz | 2100 |
RAM_Memory_GB | 512 |
Primary_Cache_MB | 4MB per core, on chip |
Secondary_Cache_MB | 2MB per 4 core, on chip |
RAM_Memory_Type | DDR4 3200 MHz |
Hw_Availability_Date | Jul-2020 |
Local_Storage | 2*448GB SSD, 1*3.84TB SSD |
Quantity | 3 |
Virtualized | KVM |
Network_Adapter_1 | 1*Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection |
Network_Adapter_2 | 1*Intel Corporation I350 Gigabit Network Connection |
Network_Adapter_3 | 1*Beijing Wangxun Technology Co.,Ltd.WX1860-LC |
Network_port_type_1 | 10GBASE-SR |
Network_port_type_2 | 1000BASE-T |
Network_port_type_3 | 1000BASE-T |
Network_speed_port_1 | 10 Gb/s |
Network_speed_port_2 | 1000 Mb/s |
Network_speed_port_3 | 1000 Mb/s |
OS_Version | Kylin-Server-10-SP2-Release |
OS_Availability_Date | Nov-2021 |
Notes | none |
Cloud Computes Nodes | |
---|---|
Parameter | Value |
type 1_Compute_nodes | 23 |
type 1_Hw_Vendor | Inspur |
type 1_Hw_Platform | CS5260F |
type 1_Quantity | 23 |
type 1_CPU_Type | Phytium,S2500/64 |
type 1_CPU_Count | 2 |
type 1_CPU_Cores_Per | 64 |
type 1_CPU_Frequency_MHz | 2100 |
type 1_RAM_Memory_GB | 512 |
type 1_Primary_Cache_MB | 4MB core, on chip |
type 1_Secondary_Cache_MB | 2MB per 4 core, on chip |
type 1_RAM_Memory_Type | DDR4 3200 MHz |
type 1_Hw_Availability_Date | Jul-2020 |
type 1_Local_Storage | 2*448GB SSD, 1*3.84TB SSD |
type 1_Virtualized | KVM |
type 1_Network_Adapter_1 | 1*Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection |
type 1_Network_Adapter_2 | 1*Intel Corporation I350 Gigabit Network Connection |
type 1_Network_Adapter_3 | 1*Beijing Wangxun Technology Co.,Ltd.WX1860-LC |
type 1_Network_port_type_1 | 10GBASE-SR |
type 1_Network_port_type_2 | 1000BASE-T |
type 1_Network_port_type_3 | 1000BASE-T |
type 1_Network_speed_port_1 | 10 Gb/s |
type 1_Network_speed_port_2 | 1000 Mb/s |
type 1_Network_speed_port_3 | 1000 Mb/s |
type 1_OS_Version | Kylin-Server-10-SP2-Release |
type 1_OS_Availability_Date | Nov-2021 |
type 1_Notes | none |
Cloud Network Information | |
---|---|
Parameter | Value |
network 1_Technology | ethernet |
network 1_Protocol | TCP/IP |
network 1_Protocol_version | IPV4 |
network 1_Speed_Mbps | 10000 |
network 1_Function | data |
network 1_Notes | None |
network 2_Technology | ethernet |
network 2_Protocol | TCP/IP |
network 2_Protocol_version | IPV4 |
network 2_Speed_Mbps | 1000 |
network 2_Function | management |
network 2_Notes | None |
network 3_Technology | ethernet |
network 3_Protocol | TCP/IP |
network 3_Protocol_version | IPV4 |
network 3_Speed_Mbps | 1000 |
network 3_Function | management |
network 3_Notes | none |
Cloud Storage | |
---|---|
Parameter | Value |
Storage 1_Attach_Type | network |
Storage 1_Capacity | 88 TB |
Storage 1_Technology | SSD |
Storage 1_Notes | each node has 2*448GB SSD RAID1 for OS and 1*3.84TB SSD for storage |