SPECstorage(TM) Solution 2020_eda_blended Result WekaIO, Inc. : Weka - Azure Public Cloud Reference SPECstorage Solution = 7700 Job_Sets (Overall Response Time = 0.65 msec) 2020_eda_blended =============================================================================== Performance =========== Business Average Metric Latency Job_Sets Job_Sets (Job_Sets) (msec) Ops/Sec MB/Sec ------------ ------------ ------------ ------------ 770 0.2 346519 5591 1540 0.3 693040 11183 2310 0.3 1039557 16773 3080 0.3 1386076 22365 3850 0.3 1732595 27956 4620 0.4 2079114 33548 5390 0.4 2425636 39139 6160 0.5 2772157 44729 6930 0.6 3118679 50325 7700 5.3 3465194 55916 =============================================================================== Product and Test Information ============================ +---------------------------------------------------------------+ | Weka - Azure Public Cloud Reference | +---------------------------------------------------------------+ Tested by WekaIO, Inc. Hardware Available September 2024 Software Available September 2024 Date Tested October 2024 License Number 4553 Licensee Locations Campbell, CA USA The WEKA Data Platform is purpose-built to seamlessly and sustainably deliver speed, simplicity, and scale that meets the needs of modern enterprises and research organizations without compromise. Its advanced, software-defined architecture supports next-generation workloads in virtually any location with cloud simplicity and on-premises performance. Solution Under Test Bill of Materials ===================================== Item No Qty Type Vendor Model/Name Description ---- ---- ---------- ---------- ---------- ----------------------------------- 1 100 Azure Azure Standard WEKA storage backends - Azure Virtual L32s v3 Standard L32s v3 Virtual Machine Machine (32 vCPUs, 256 GiB memory, 16 Gbps networking, 4 x 1.92TB NVMe) 2 64 Azure Azure Standard Ubuntu clients with Weka POSIX- Virtual E32s v5 compliant file system driver - Machine Azure Standard E32s v5 Virtual Machine (32 vCPUs, 256 GiB memory, 16 Gbps networking) Configuration Diagrams ====================== 1) storage2020-20241015-00102.config1.png (see SPECstorage Solution 2020 results webpage) Component Software ================== Item Name and No Component Type Version Description ---- ------------ ------------ ------------ ----------------------------------- 1 WekaFS File System Version 4.3. The WEKA filesystem (WekaFS) 5.109-azure redefines storage solutions with its software-only approach, WekaFS addresses common storage challenges by removing performance bottlenecks, making it suitable for environments requiring low latency, high performance, and cloud scalability. 2 Weka Server Storage OS Ubuntu 20.04 Operating System (OS) for 100 storage virtual machines using Azure L32s v3 instances 3 Clients Client OS Ubuntu 20.04 Operating System (OS) for 64 client virtual machines using Azure E32s v5 instances Hardware Configuration and Tuning - Virtual =========================================== +----------------------------------------------------------------------+ | Component Name | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- Accelerated Enabled L32s and E32s virtual machines have 16 Networking Gbps connectivity Hardware Configuration and Tuning Notes --------------------------------------- None Software Configuration and Tuning - Virtual =========================================== +----------------------------------------------------------------------+ | Networking | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- Jumbo Frames 3900 Enables Ethernet jumbo frames up to 3900 bytes Software Configuration and Tuning Notes --------------------------------------- The single filesystem was attached via a single mount per client. Four WEKA front ends (cores) were used on the clients. Note that this system was deployed entirely using WEKA's Terraform Module. You can create a Terraform template from WEKA's Cloud Deployment Manager at https://cloud.weka.io. Clients automount the WekaFS filesystem when the Terraform deployment completes. Service SLA Notes ----------------- None Storage and Filesystems ======================= Item Stable No Description Data Protection Storage Qty ---- ------------------------------------- ------------------ -------- ----- 1 Weka Filesystem with 682TB of usable WEKA 16+2 Local 400 storage distributed data 1.92TB protection NVMe Disk Number of Filesystems 1 Total Capacity 682 TB Filesystem Type WekaFS Filesystem Creation Notes ------------------------- Each storage backend has four Azure SSDs attached to it, which are dedicated to the WEKA filesystem created. The storage cluster consisted of 100 storage servers with a single WEKA filesystem created in the cluster. Each client mounted the WEKA filesystem with a single mount. Storage and Filesystem Notes ---------------------------- Three cores assigned to the FE clients, which is specified in the Terraform configuration file. Transport Configuration - Virtual ================================= Item Number of No Transport Type Ports Used Notes ---- --------------- ---------- ----------------------------------------------- 1 16 Gbps Virtual 100 Used by Weka Backend Server Nodes Nic 2 16 Gbps Virtual 64 Used by Weka Frontend Client Nodes Nic Transport Configuration Notes ----------------------------- None Switches - Virtual ================== Total Used Item Port Port No Switch Name Switch Type Count Count Notes ---- -------------------- --------------- ------ ----- ------------------------ 1 Azure 16 Gbps 100 100 Used by Weka Backend Ethernet with Server Nodes Accelerated Networking 2 Azure 16 Gbps 64 64 Used by Weka Frontend Ethernet with Client Nodes Accelerated Networking Processing Elements - Virtual ============================= Item No Qty Type Location Description Processing Function ---- ---- -------- -------------- ------------------------- ------------------- 1 3200 vCPU L32s v3 Weka 2.8 GHz Intel(R) Xeon(R) WekaFS, Network Backend Platinum 8370C processors Communications, Storage Functions 2 2048 vCPU E32s v5 Weka 2.8 GHz Intel(R) Xeon(R) WekaFS, Network Frontend Platinum 8370C processors Communications, Storage Functions Processing Element Notes ------------------------ None Memory - Virtual ================ Size in Number of Description GiB Instances Nonvolatile Total GiB ------------------------- ---------- ---------- ------------ ------------ Azure L32s v3 Virtual 256 100 V 25600 Machine Memory Azure E32s v5 Virtual 256 64 V 16384 Machine Memory Grand Total Memory Gibibytes 41984 Memory Notes ------------ None Stable Storage ============== WekaFS does not use any internal memory to temporarily cache write data to the underlying storage system. All writes are committed directly to the storage disks and protected via WekaFS Distributed Data Protection (16+2 in this case). There is no need for any RAM battery protection. In an event of a power failure a write in transit would not be acknowledged. Solution Under Test Configuration Notes ======================================= The solution under test was a standard distributed cluster built with Weka software. Weka clusters can handle large and small file I/O with intensive metadata operations for HPC applications with no tuning required. Other Solution Notes ==================== None Dataflow ======== None Other Notes =========== None Other Report Notes ================== None =============================================================================== Generated on Fri Oct 18 03:32:54 2024 by SpecReport Copyright (C) 2016-2024 Standard Performance Evaluation Corporation