SPECstorage(TM) Solution 2020_genomics Result Nettrix : Nettrix with 6 NVMe Storage Server SPECstorage Solution = 33 Jobs (Overall Response Time = 0.16 msec) 2020_genomics =============================================================================== Performance =========== Business Average Metric Latency (Jobs) (msec) Jobs Ops/Sec Jobs MB/Sec ------------ ------------ ------------ ------------ 3 0.2 3000 255 6 0.2 6000 509 9 0.2 9000 765 12 0.2 12000 1019 15 0.2 15000 1274 18 0.2 18000 1527 21 0.2 21000 1784 24 0.2 24000 2038 27 0.2 27000 2293 30 0.2 30000 2548 33 0.2 33000 2803 =============================================================================== Product and Test Information ============================ +---------------------------------------------------------------+ | Nettrix with 6 NVMe Storage Server | +---------------------------------------------------------------+ Tested by Nettrix Hardware Available Apr 2021 Software Available Apr 2021 Date Tested Dec 2021 License Number 6138 Licensee Locations Beijing, China Nettrix R620 G40 makes full use of computing ,storage and network resources in a limited space. It can flexibly allocate resources according to business needs to achieve excellent cost performance and energy consumption ratio. It is widely applicable to various industries such as Internet, finance, communication and transportation to meet the needs of different business models. Solution Under Test Bill of Materials ===================================== Item No Qty Type Vendor Model/Name Description ---- ---- ---------- ---------- ---------- ----------------------------------- 1 1 Storage Nettrix R620 G40 The current R620 G40 is - 2 Intel Server Xeon 40 core processor, total 1 TiB memory, and dual socket MB - using NFSv4 protocol over a 100GbE NIC. R620 G40 server provides IO/s from 6 file systems. The R620 G40 server uses a dual socket processor, 1 PCIe Gen3.1 SSD, 6 PCIe Gen4 SSDs. R620 G40 is running RHEL8.3 on PCIe Gen3.1 SSD using NFSv4 and 1 100GbE Ethernet networking. 2 1 Ethernet NVIDIA(Mel SN2410 Mellanox Spectrum®-based 48-port Switch lanox) 25GbE + 8-port 100GbE Open Ethernet Platform. 3 1 Clients Nettrix R620 G40 The current R620 G40 is - 2 Intel Server Xeon 40 core processor, total 512 GiB memory, and dual socket MB - using NFSv4 protocol over a 100GbE NIC. The R620 G40 server uses a dual socket processor, 1 960GB SATA SSD for OS, 1 1.0 TB PCIe Gen3.1 SSD for storage. R620 G40 is running ESXi 6.7 OS on SATA SSD using NFSv4 and 1 100GbE Ethernet networking. The R620 G40 server contains 8 virtual machines, each VM has: 16 vCPUs, 50GB memory, 100GB storage and a 100GB network port provided by the SR-IOV function. 4 1 Disk Samsung MZ7KH960 960GB 2.5" SATA SSD installed in clients server (R620 G40) for ESXI OS. 5 2 Disk Intel SSDPE2KX01 1TB PCIe Gen3.1 NVMe disk: 1 of 2 0T8 installed in storage server (R620 G40) for RHEL8.3 OS, 1 of 2 installed in clients server (R620 G40) used to store VMs. 6 6 Disk Samsung MZQL27T60 7.68TB PCIe Gen4 NVMe installed in storage server (R620 G40). 7 2 Ethernet NVIDIA(Mel MCX623436A ConnectX®-6 Dx EN adapter card, Card lanox) N-CDAB 100GbE, OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket.1 of 2 installed in storage server (R620 G40), 1 of 2 installed in clients server (R620 G40). Configuration Diagrams ====================== 1) storage2020-20220111-00032.config1.png (see SPECstorage Solution 2020 results webpage) Component Software ================== Item Name and No Component Type Version Description ---- ------------ ------------ ------------ ----------------------------------- 1 Storage Linux RHEL 8.3 Storage Server Operating System. Server 2 Clients ESXi Server ESXi-6.7.0 The OS version is Server ESXi-6.7.0-20190802001-standard. 3 Clients Linux RHEL 8.3 The VMware ESXi 6.7 server was configured to run 8 VM's running RHEL 8.3 OS. Hardware Configuration and Tuning - Physical ============================================ +----------------------------------------------------------------------+ | Storage Server | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- MTU 1500 Default value of OS +----------------------------------------------------------------------+ | Clients Server | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- SR-IOV Enabled Network card's SR-IOV function in BIOS is set to Enabled +----------------------------------------------------------------------+ | Clients | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- MTU 1500 Default value of OS Hardware Configuration and Tuning Notes --------------------------------------- Each VM has a 100GB network port provided by SR-IOV function, and VM use default vswitch and default 1Gb vNIC. Software Configuration and Tuning - Physical ============================================ +----------------------------------------------------------------------+ | N/A | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- N/A N/A N/A Software Configuration and Tuning Notes --------------------------------------- NFSv4 is in sync mode. Service SLA Notes ----------------- None Storage and Filesystems ======================= Item Stable No Description Data Protection Storage Qty ---- ------------------------------------- ------------------ -------- ----- 1 960GB for clients server ESXI OS None Yes 1 2 1.0TB to store VMs date OS None Yes 1 3 1.0TB for storage server OS None Yes 1 4 6x7.68TB for storage server IOs None Yes 6 Number of Filesystems 6 Total Capacity 46.08 TiB Filesystem Type xfs Filesystem Creation Notes ------------------------- The file systems were created on the storage server using all default parameters. Storage and Filesystem Notes ---------------------------- The 46.08TiB was equally allocated across all 6 filesystems. Transport Configuration - Physical ================================== Item Number of No Transport Type Ports Used Notes ---- --------------- ---------- ----------------------------------------------- 1 100GbE 2 Storage server and clients server both connect to the 100Gb link Transport Configuration Notes ----------------------------- None Switches - Physical =================== Total Used Item Port Port No Switch Name Switch Type Count Count Notes ---- -------------------- --------------- ------ ----- ------------------------ 1 SN2410 Ethernet Switch 56 2 8x 100GbE and 48x 25GbE ports are available. 2x 100GbE ports are used. Processing Elements - Physical ============================== Item No Qty Type Location Description Processing Function ---- ---- -------- -------------- ------------------------- ------------------- 1 2 CPU Storage Server Intel(R) Xeon(R) Platinum Storage Server 8380 CPU @ 2.30GHz, hyperthreading enabled 2 80 vCPU Clients Server Dual Intel(R) Xeon(R) Clients Server Platinum 8380 CPU @ 2.30GHz each with 40 cores Processing Element Notes ------------------------ Clients server and storage server have the same CPU, However, in order to ensure the normal operation of the clients server's ESXi OS, Each VM has 10 vCPUs only. Memory - Physical ================= Size in Number of Description GiB Instances Nonvolatile Total GiB ------------------------- ---------- ---------- ------------ ------------ System memory in storage 32 32 NV 1024 server System memory in clients 32 16 NV 512 server Grand Total Memory Gibibytes 1536 Memory Notes ------------ None Stable Storage ============== The storage server shares NFS in sync mode, so all NFS operations by clients are immediately committed to disk without passing through memory. The entire SUT is protected with redundant power supplies, both storage server and clients server. Solution Under Test Configuration Notes ======================================= None Other Solution Notes ==================== Use the spectre-meltdown-checker tool to check the storage server, and the results are shown as follows: 1.CVE-2017-5753 aka 'Spectre Variant 1, bounds check bypass'>STATUS: NOT VULNERABLE (Mitigation: Load fences, __user pointer sanitization) 2.CVE-2017-5715 aka 'Spectre Variant 2, branch target injection'>STATUS: NOT VULNERABLE (Enhanced IBRS + IBPB are mitigating the vulnerability) 3.CVE-2017-5754 aka 'Variant 3, Meltdown, rogue data cache load'>STATUS: NOT VULNERABLE (your CPU vender reported your CPU model as not vulnerable) Dataflow ======== All the clients mounted 6 file systems from the storage server as follows: server:/storage/nvme1 /nfs/nvme1 nfs defaults 0 0 server:/storage/nvme2 /nfs/nvme2 nfs defaults 0 0 server:/storage/nvme3 /nfs/nvme3 nfs defaults 0 0 server:/storage/nvme4 /nfs/nvme4 nfs defaults 0 0 server:/storage/nvme5 /nfs/nvme5 mfs defaults 0 0 server:/storage/nvme6 /nfs/nvme6 mfs defaults 0 0 Other Notes =========== None Other Report Notes ================== None =============================================================================== Generated on Wed Feb 23 14:21:00 2022 by SpecReport Copyright (C) 2016-2022 Standard Performance Evaluation Corporation