Copyright © 2018 Standard Performance Evaluation Corporation |
Cloud Vendor: Inspur
Cloud Type / SUT Type: private/whitebox Hardware Platform: x86 Hypervisor: KVM Cloud Infrastructure: InCloudOpenStack V5 |
Replicated Application Instances: 150 copies
Performance Score: 136.4 Relative Scalability: 90.9% Mean Instance Provisioning Time: 40s |
Tested by: Inspur | SPEC Licence Number : 3358 | Test Date : Nov 16, 2020 |
Performance Sections
Performance Summary Performance Details Validation, Errors, and Issues Glossary of Terms |
SUT Configuration Sections
Instance Configuration Cloud Configuration Network Configuration Storage Configuration |
Scale-out Phase Date/Time and Test Region
Scale-out Start Time: 2020-11-13_15:06:34_UTC Scale-out End Time: 2020-11-14_00:42:41_UTC Test Region: CN Central Standard Time |
Cloud Informational Metrics
AI Provisioning Success: 100.00% AI Run Success: 100.00 Total Instances: 975 |
Baseline Summary Results for YCSB | ||||
---|---|---|---|---|
Throughput (ops/s) | Insert Latency 99% (ms) | Read Latency 99% (ms) | AI Provisioning Time (s) | |
Average | 26486.5 | 3.041 | 3.648 | 497.6 |
Baseline Summary Results for KMeans | ||
---|---|---|
Completion Time (s) | AI Provisioning Time (s) | |
Average | 111.16 | 450.0 |
Scale-out Summary Results for YCSB for 75 Valid AIs | |||||
---|---|---|---|---|---|
Av. Throughput (ops/s) | Av. Insert Latency 99% (ms) | Av. Read Latency 99% (ms) | Av. Provisioning Time (s) | Performance Score | Relative Scalability (%) |
22047.9 | 3.856 | 4.820 | 462.6 | 49.44 | 85.20 |
Scale-out Summary Results for KMeans for 75 Valid AIs | |||
---|---|---|---|
Av. Completion Time (s) | Av. Provisioning Time (s) | Performance Score | Relative Scalability (%) |
120.2 | 448.2 | 86.96 | 96.54 |
YCSB Summary Results by AI | |||||||
---|---|---|---|---|---|---|---|
AI name | Run count | Run codes | Av. Throughput (ops/s) | Av. Insert Latency 99% (ms) | Av. Read Latency 99% (ms) | AI. Provisioning time (s) | AI. Prov. Initiated from Scale-out Start (s) |
ai_1 | 127 | 0 | 25972.6 | 3.383 | 3.927 | 460.0 | 7.0 |
ai_3 | 123 | 0 | 25252.3 | 3.605 | 4.211 | 456.0 | 404.0 |
ai_5 | 119 | 0 | 25206.1 | 3.456 | 3.945 | 465.0 | 945.0 |
ai_8 | 110 | 0 | 23052.8 | 3.781 | 4.314 | 459.0 | 1486.0 |
ai_10 | 114 | 0 | 24197.9 | 3.580 | 4.185 | 461.0 | 1997.0 |
ai_11 | 112 | 0 | 25195.3 | 3.354 | 4.017 | 458.0 | 2491.0 |
ai_14 | 108 | 0 | 25072.2 | 3.685 | 4.349 | 460.0 | 3017.0 |
ai_16 | 105 | 0 | 24778.0 | 3.561 | 4.412 | 462.0 | 3430.0 |
ai_18 | 112 | 0 | 26424.1 | 3.263 | 3.835 | 459.0 | 3923.0 |
ai_20 | 104 | 0 | 24450.1 | 3.632 | 4.207 | 461.0 | 4457.0 |
ai_22 | 101 | 0 | 24281.6 | 3.660 | 4.188 | 456.0 | 4889.0 |
ai_24 | 99 | 0 | 24100.9 | 3.691 | 4.390 | 465.0 | 5455.0 |
ai_26 | 101 | 0 | 24767.4 | 3.462 | 4.022 | 460.0 | 5857.0 |
ai_28 | 91 | 0 | 22960.4 | 3.794 | 4.802 | 461.0 | 6240.0 |
ai_30 | 90 | 0 | 23458.2 | 3.860 | 4.961 | 463.0 | 6686.0 |
ai_32 | 95 | 0 | 25382.6 | 3.471 | 4.407 | 462.0 | 7245.0 |
ai_34 | 91 | 0 | 23810.2 | 3.608 | 4.264 | 461.0 | 7691.0 |
ai_36 | 89 | 0 | 24618.0 | 3.513 | 4.106 | 461.0 | 8195.0 |
ai_39 | 88 | 0 | 24122.8 | 3.572 | 4.284 | 458.0 | 8728.0 |
ai_40 | 86 | 0 | 25140.4 | 3.396 | 4.114 | 458.0 | 9224.0 |
ai_42 | 81 | 0 | 23003.9 | 4.029 | 4.868 | 462.0 | 9632.0 |
ai_44 | 78 | 0 | 23181.6 | 3.613 | 4.224 | 461.0 | 10034.0 |
ai_46 | 75 | 0 | 22487.2 | 3.856 | 4.610 | 463.0 | 10528.0 |
ai_48 | 78 | 0 | 24450.3 | 3.595 | 4.431 | 462.0 | 10974.0 |
ai_50 | 73 | 0 | 23476.8 | 3.790 | 4.889 | 458.0 | 11571.0 |
ai_53 | 79 | 0 | 24946.9 | 3.590 | 4.423 | 463.0 | 12029.0 |
ai_55 | 67 | 0 | 21608.7 | 3.894 | 4.603 | 460.0 | 12500.0 |
ai_57 | 69 | 0 | 23269.6 | 3.681 | 4.433 | 461.0 | 13007.0 |
ai_59 | 65 | 0 | 22417.3 | 3.639 | 4.516 | 463.0 | 13593.0 |
ai_61 | 58 | 0 | 19931.2 | 4.493 | 5.344 | 462.0 | 13934.0 |
ai_63 | 62 | 0 | 22229.9 | 3.619 | 4.268 | 462.0 | 14462.0 |
ai_65 | 60 | 0 | 22849.6 | 3.709 | 4.855 | 464.0 | 14991.0 |
ai_67 | 66 | 0 | 24368.2 | 3.643 | 4.169 | 462.0 | 15402.0 |
ai_69 | 57 | 0 | 23050.0 | 3.599 | 4.344 | 460.0 | 15741.0 |
ai_71 | 54 | 0 | 22564.9 | 3.864 | 5.131 | 469.0 | 16179.0 |
ai_72 | 51 | 0 | 21668.7 | 4.044 | 5.238 | 463.0 | 16631.0 |
ai_74 | 49 | 0 | 20960.9 | 4.011 | 5.037 | 461.0 | 17003.0 |
ai_77 | 49 | 0 | 21851.8 | 3.838 | 4.578 | 462.0 | 17404.0 |
ai_78 | 50 | 0 | 22175.9 | 3.482 | 4.337 | 463.0 | 17805.0 |
ai_80 | 48 | 0 | 21470.0 | 3.870 | 4.766 | 463.0 | 18161.0 |
ai_82 | 49 | 0 | 22108.2 | 3.888 | 4.707 | 463.0 | 18757.0 |
ai_84 | 43 | 0 | 20684.7 | 3.863 | 4.684 | 462.0 | 19118.0 |
ai_86 | 45 | 0 | 22229.0 | 3.688 | 4.732 | 462.0 | 19464.0 |
ai_88 | 45 | 0 | 23073.7 | 3.670 | 4.531 | 465.0 | 19957.0 |
ai_90 | 40 | 0 | 20815.6 | 3.962 | 4.873 | 469.0 | 20340.0 |
ai_92 | 36 | 0 | 19841.4 | 3.913 | 4.962 | 464.0 | 20868.0 |
ai_94 | 34 | 0 | 19459.7 | 4.455 | 6.082 | 466.0 | 21259.0 |
ai_96 | 33 | 0 | 19465.1 | 3.960 | 5.218 | 464.0 | 21728.0 |
ai_98 | 34 | 0 | 20768.6 | 4.077 | 5.091 | 463.0 | 22044.0 |
ai_100 | 35 | 0 | 22315.7 | 3.543 | 4.276 | 463.0 | 22432.0 |
ai_102 | 31 | 0 | 21009.2 | 3.745 | 4.728 | 469.0 | 22979.0 |
ai_104 | 29 | 0 | 19946.7 | 3.724 | 4.876 | 466.0 | 23298.0 |
ai_106 | 31 | 0 | 21722.5 | 3.742 | 4.798 | 464.0 | 23740.0 |
ai_108 | 29 | 0 | 21855.4 | 3.538 | 4.319 | 459.0 | 24046.0 |
ai_110 | 27 | 0 | 21610.2 | 3.664 | 4.559 | 472.0 | 24618.0 |
ai_111 | 23 | 0 | 18502.6 | 4.675 | 5.941 | 461.0 | 25010.0 |
ai_113 | 22 | 0 | 19096.0 | 4.515 | 6.431 | 464.0 | 25566.0 |
ai_115 | 20 | 0 | 18971.1 | 4.318 | 6.579 | 465.0 | 25939.0 |
ai_117 | 19 | 0 | 18240.4 | 5.067 | 6.430 | 466.0 | 26242.0 |
ai_119 | 17 | 0 | 18521.0 | 4.653 | 6.847 | 464.0 | 26829.0 |
ai_121 | 18 | 0 | 20091.6 | 4.127 | 4.982 | 461.0 | 27172.0 |
ai_123 | 19 | 0 | 20837.1 | 3.836 | 4.848 | 462.0 | 27606.0 |
ai_125 | 15 | 0 | 19442.1 | 4.027 | 5.118 | 461.0 | 28158.0 |
ai_127 | 14 | 0 | 18637.9 | 4.455 | 5.655 | 466.0 | 28565.0 |
ai_129 | 13 | 0 | 20414.0 | 3.629 | 4.305 | 462.0 | 29092.0 |
ai_131 | 11 | 0 | 19947.9 | 4.749 | 5.382 | 465.0 | 29524.0 |
ai_133 | 10 | 0 | 20601.9 | 4.005 | 4.986 | 460.0 | 30081.0 |
ai_135 | 9 | 0 | 19496.9 | 4.120 | 5.440 | 463.0 | 30512.0 |
ai_137 | 8 | 0 | 20177.0 | 3.981 | 5.349 | 462.0 | 30898.0 |
ai_139 | 6 | 0 | 19431.3 | 3.947 | 5.078 | 464.0 | 31305.0 |
ai_141 | 5 | 0 | 19620.7 | 4.052 | 5.229 | 464.0 | 31747.0 |
ai_143 | 5 | 0 | 20705.0 | 3.742 | 5.139 | 465.0 | 32154.0 |
ai_145 | 4 | 0 | 20758.9 | 3.905 | 5.207 | 463.0 | 32732.0 |
ai_147 | 2 | 0 | 19956.7 | 4.315 | 6.095 | 468.0 | 33283.0 |
ai_149 | 1 | 0 | 19030.9 | 4.443 | 5.983 | 466.0 | 33664.0 |
ai_151 | 0 | 4 | 0.0 | 0.000 | 0.000 | 0.0 | 34257.0 |
KMeans Summary Results by AI | |||||
---|---|---|---|---|---|
AI name | Run count | Run code | Av. Completion Time (s) | Av. Provisioning time (s) | AI. Prov. Initiated from Scale-out Start (s) |
ai_2 | 213 | 0 | 118.58 | 447.0 | 14.0 |
ai_4 | 205 | 0 | 121.35 | 446.0 | 571.0 |
ai_6 | 205 | 0 | 119.39 | 446.0 | 1022.0 |
ai_7 | 210 | 0 | 114.67 | 444.0 | 1439.0 |
ai_9 | 209 | 0 | 114.36 | 438.0 | 1957.0 |
ai_12 | 197 | 0 | 119.70 | 444.0 | 2521.0 |
ai_13 | 197 | 0 | 116.45 | 444.0 | 2929.0 |
ai_15 | 192 | 0 | 118.52 | 443.0 | 3270.0 |
ai_17 | 187 | 0 | 120.52 | 444.0 | 3723.0 |
ai_19 | 187 | 0 | 118.27 | 441.0 | 4215.0 |
ai_21 | 184 | 0 | 117.90 | 445.0 | 4708.0 |
ai_23 | 181 | 0 | 118.56 | 444.0 | 5009.0 |
ai_25 | 178 | 0 | 118.44 | 441.0 | 5555.0 |
ai_27 | 177 | 0 | 116.62 | 443.0 | 6146.0 |
ai_29 | 172 | 0 | 116.44 | 442.0 | 6619.0 |
ai_31 | 163 | 0 | 122.29 | 445.0 | 7152.0 |
ai_33 | 173 | 0 | 113.22 | 442.0 | 7476.0 |
ai_35 | 166 | 0 | 116.05 | 442.0 | 7794.0 |
ai_37 | 158 | 0 | 120.34 | 444.0 | 8225.0 |
ai_38 | 157 | 0 | 120.38 | 441.0 | 8684.0 |
ai_41 | 147 | 0 | 124.22 | 444.0 | 9250.0 |
ai_43 | 152 | 0 | 116.86 | 445.0 | 9832.0 |
ai_45 | 146 | 0 | 119.63 | 485.0 | 10328.0 |
ai_47 | 143 | 0 | 121.29 | 441.0 | 10736.0 |
ai_49 | 137 | 0 | 123.29 | 445.0 | 11284.0 |
ai_51 | 142 | 0 | 116.66 | 443.0 | 11681.0 |
ai_52 | 136 | 0 | 119.64 | 442.0 | 11994.0 |
ai_54 | 138 | 0 | 115.66 | 470.0 | 12315.0 |
ai_56 | 128 | 0 | 124.41 | 445.0 | 12697.0 |
ai_58 | 136 | 0 | 112.29 | 438.0 | 13293.0 |
ai_60 | 124 | 0 | 121.56 | 444.0 | 13684.0 |
ai_62 | 120 | 0 | 122.70 | 445.0 | 14175.0 |
ai_64 | 116 | 0 | 125.32 | 445.0 | 14566.0 |
ai_66 | 112 | 0 | 124.67 | 447.0 | 15162.0 |
ai_68 | 110 | 0 | 124.20 | 449.0 | 15646.0 |
ai_70 | 111 | 0 | 120.08 | 443.0 | 16147.0 |
ai_73 | 102 | 0 | 128.98 | 443.0 | 16671.0 |
ai_75 | 102 | 0 | 122.87 | 448.0 | 17037.0 |
ai_76 | 101 | 0 | 123.29 | 501.0 | 17378.0 |
ai_79 | 96 | 0 | 125.23 | 443.0 | 17890.0 |
ai_81 | 103 | 0 | 110.49 | 441.0 | 18424.0 |
ai_83 | 94 | 0 | 119.22 | 442.0 | 18933.0 |
ai_85 | 89 | 0 | 122.65 | 443.0 | 19329.0 |
ai_87 | 87 | 0 | 120.55 | 448.0 | 19801.0 |
ai_89 | 83 | 0 | 125.19 | 444.0 | 20147.0 |
ai_91 | 85 | 0 | 117.86 | 452.0 | 20554.0 |
ai_93 | 74 | 0 | 134.14 | 445.0 | 20916.0 |
ai_95 | 82 | 0 | 114.30 | 445.0 | 21327.0 |
ai_97 | 71 | 0 | 129.85 | 447.0 | 21736.0 |
ai_99 | 74 | 0 | 120.47 | 444.0 | 22102.0 |
ai_101 | 67 | 0 | 127.09 | 450.0 | 22570.0 |
ai_103 | 65 | 0 | 126.83 | 451.0 | 23001.0 |
ai_105 | 66 | 0 | 118.94 | 447.0 | 23477.0 |
ai_107 | 61 | 0 | 121.77 | 445.0 | 24013.0 |
ai_109 | 59 | 0 | 118.98 | 449.0 | 24474.0 |
ai_112 | 51 | 0 | 131.33 | 450.0 | 25040.0 |
ai_114 | 49 | 0 | 127.33 | 443.0 | 25603.0 |
ai_116 | 49 | 0 | 118.80 | 442.0 | 26130.0 |
ai_118 | 42 | 0 | 134.36 | 446.0 | 26622.0 |
ai_120 | 43 | 0 | 120.86 | 482.0 | 27013.0 |
ai_122 | 37 | 0 | 133.11 | 448.0 | 27444.0 |
ai_124 | 37 | 0 | 124.89 | 439.0 | 27955.0 |
ai_126 | 32 | 0 | 132.31 | 449.0 | 28344.0 |
ai_128 | 29 | 0 | 129.79 | 458.0 | 28925.0 |
ai_130 | 29 | 0 | 122.03 | 447.0 | 29258.0 |
ai_132 | 24 | 0 | 137.79 | 451.0 | 29769.0 |
ai_134 | 23 | 0 | 122.00 | 448.0 | 30176.0 |
ai_136 | 21 | 0 | 122.10 | 443.0 | 30608.0 |
ai_138 | 16 | 0 | 123.62 | 529.0 | 31181.0 |
ai_140 | 15 | 0 | 122.80 | 448.0 | 31577.0 |
ai_142 | 12 | 0 | 122.17 | 448.0 | 32068.0 |
ai_144 | 8 | 0 | 136.12 | 449.0 | 32557.0 |
ai_146 | 7 | 0 | 124.57 | 442.0 | 32980.0 |
ai_148 | 3 | 0 | 140.33 | 443.0 | 33547.0 |
ai_150 | 1 | 0 | 127.00 | 448.0 | 33938.0 |
ai_152 | 0 | 4 | 0 | 0.0 | 34412.0 |
Instance Configuration Hadoop Master | |
---|---|
Parameter | Value |
instance_type_name | medium |
cpu | 4 |
memory | 4GB |
disk_size | 40GB |
disk_backed | block storage |
image_name | hadoop_kmeans |
Notes | some text |
Instance Configuration Hadoop Slave | |
---|---|
Parameter | Value |
instance_type_name | medium |
cpu | 4 |
memory | 4GB |
disk_size | 40GB |
disk_backed | block storage |
image_name | hadoop_kmeans |
Notes | some text |
Instance Configuration YCSB | |
---|---|
Parameter | Value |
instance_type_name | medium |
cpu | 4 |
memory | 4GB |
disk_size | 40GB |
disk_backed | block storage |
image_name | cassandra_ycsb |
Notes | some text |
Instance Configuration Cassandra | |
---|---|
Parameter | Value |
instance_type_name | medium |
cpu | 4 |
memory | 4GB |
disk_size | 40GB |
disk_backed | block storage |
image_name | cassandra_ycsb |
Notes | some text |
Cloud High Level Information and Availability | |
---|---|
Parameter | Value |
Name | IncloudOpenStack |
Type | private |
Sut_Type | whitebox |
Virtualized | KVM |
Manager_Protocol | InCloudOpenStack |
Manager_Version | V5 |
Hardware_Availability | Apr-2018 |
Software/Service_Availability | Apr-2018 |
Geographic_Distribution | 1 |
Notes | Cloud management deputy nodes reside at all data centers SUT exists in 3 different buildings within same campus Campus network backbone is infinet10000. |
Cloud Under Test Software Levels | |
---|---|
Parameter | Value |
Python_version | 2.7.12 |
JVM_version | 1.8.0_242 |
Hadoop_version | 2.7.5 |
Cassandra_version | 2.1.20 |
Notes | All software compiled locally from git source archives Compiler options - debug, 128bits, optimized Internal database set to emulate Cassandra API. |
Benchmark Harness Node | |
---|---|
Parameter | Value |
Vendor | Genuine Intel |
Platform | NF5280M5 |
CPU_Description | Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz |
CPU_Frequency_MHz | 2200 |
RAM_Memory | 128 GB, ECC, DDR4, 2933MHz RDIMM |
Local_Storage | 2 x 480G SSD RAID1 |
Quantity | 3 |
Availability_Date | Apr-2019 |
OS_Version | Ubuntu 16.04.2 LTS |
OS_Availability_Date | Nov-2019 |
Network_Adapter_1 | 1 x Intel Corporation X550T 10-Gigabit SFI/SFP+ Network Connection |
Network_port_type_1 | 10GBASE-SR |
Network_port_type_2 | 10GBASE-SR |
Network_speed_port_1 | 10 Gb/s |
Network_speed_port_2 | 10 Gb/s |
Notes | None |
Cloud Manager Node | |
---|---|
Parameter | Value |
Hw_Vendor | Inspur |
Hw_Platform | NF5180M5 |
CPU_Type | Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz |
CPU_Count | 2 |
CPU_Cores_Per | 24 |
CPU_Frequency_MHz | 2200 |
RAM_Memory_GB | 128 |
Cache L1 | 32 KB I + 32 KB D on chip per core |
Cache L2 | 1 MB I+D on chip per core |
RAM_Memory_Type | ECC DDR4 2933 MHz |
Hw_Availability_Date | Apr-2019 |
Local_Storage | 2 x 480G SSD RAID1,6 x 480G SSD |
Quantity | 1 |
Virtualized | KVM |
Network_Adapter_1 | 1 x Intel Corporation X550T 10-Gigabit SFI/SFP+ Network Connection |
Network_port_type_1 | 10GBASE-SR |
Network_port_type_2 | 10GBASE-SR |
Network_speed_port_1 | 10 Gb/s |
Network_speed_port_2 | 10 Gb/s |
OS_Version | InCloudOpenStack V5 |
OS_Availability_Date | Dec-2019 |
Notes | None |
Cloud Computes Nodes | |
---|---|
Parameter | Value |
type 1_Compute_nodes | 97 |
type 1_Hw_Vendor | Inspur |
type 1_Hw_Platform | Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz |
type 1_Quantity | 97 |
type 1_CPU_Type | x86 |
type 1_CPU_Count | 2 |
type 1_CPU_Cores_Per | 24 |
type 1_CPU_Frequency_MHz | 2200 |
type 1_RAM_Memory_GB | 128G |
type 1_Cache L1 | 32 KB I + 32 KB D on chip per core |
type 1_Cache L2 | 1 MB I+D on chip per core |
type 1_RAM_Memory_Type | ECC DDR4 2933 MHz |
type 1_Hw_Availability_Date | Apr-2019 |
type 1_Local_Storage | 2 x 480G SSD RAID1, 6 x 480G SSD |
type 1_Virtualized | KVM |
type 1_Network_Adapter_1 | 1 x Intel Corporation X550T 10-Gigabit SFI/SFP+ Network Connection |
type 1_Network_port_type_1 | 10GBASE-SR |
type 1_Network_port_type_2 | 10GBASE-SR |
type 1_Network_speed_port_1 | 10 Gb/s |
type 1_Network_speed_port_2 | 10 Gb/s |
type 1_OS_Version | InCloudOpenStack V5 |
type 1_OS_Availability_Date | Dec-2019 |
type 1_Notes | None |
Cloud Network Information | |
---|---|
Parameter | Value |
network 1_Technology | ethernet |
network 1_Protocol | TCP/IP |
network 1_Protocol_version | IPV4 |
network 1_Speed_Mbps | 10000 |
network 1_Function | data |
network 1_Notes | None |
network 2_Technology | ethernet |
network 2_Protocol | TCP/IP |
network 2_Protocol_version | IPV4 |
network 2_Speed_Mbps | 1000 |
network 2_Function | management |
network 2_Notes | network_2 related notes |
Cloud Storage | |
---|---|
Parameter | Value |
Storage 1_Attach_Type | local |
Storage 1_Capacity | 279 TB |
Storage 1_Technology | SSD |
Storage 1_Notes | Each node has 6 480G SSD for storage Each node has 2 480G SSD RAID 1 for OS |