SPECstorage(TM) Solution 2020_swbuild Result WekaIO, Inc. : Weka - Azure Public Cloud Reference SPECstorage Solution = 5000 Builds (Overall Response Time = 0.25 msec) 2020_swbuild =============================================================================== Performance =========== Business Average Metric Latency Builds Builds (Builds) (msec) Ops/Sec MB/Sec ------------ ------------ ------------ ------------ 500 0.2 250009 2034 1000 0.2 500020 4068 1500 0.2 750029 6102 2000 0.2 1000037 8135 2500 0.2 1250048 10170 3000 0.3 1500061 12204 3500 0.3 1750065 14238 4000 0.3 2000077 16272 4500 0.3 2250088 18306 5000 0.3 2500100 20340 =============================================================================== Product and Test Information ============================ +---------------------------------------------------------------+ | Weka - Azure Public Cloud Reference | +---------------------------------------------------------------+ Tested by WekaIO, Inc. Hardware Available September 2024 Software Available September 2024 Date Tested October 2024 License Number 4553 Licensee Locations Campbell, CA USA The WEKA Data Platform is purpose-built to seamlessly and sustainably deliver speed, simplicity, and scale that meets the needs of modern enterprises and research organizations without compromise. Its advanced, software-defined architecture supports next-generation workloads in virtually any location with cloud simplicity and on-premises performance. Solution Under Test Bill of Materials ===================================== Item No Qty Type Vendor Model/Name Description ---- ---- ---------- ---------- ---------- ----------------------------------- 1 100 Azure Azure Standard WEKA storage backends - Azure Virtual L32s v3 Standard L32s v3 Virtual Machine Machine (32 vCPUs, 256 GiB memory, 16 Gbps networking, 4 x 1.92TB NVMe) 2 64 Azure Azure Standard Ubuntu clients with Weka POSIX- Virtual E32s v5 compliant file system driver - Machine Azure Standard E32s v5 Virtual Machine (32 vCPUs, 256 GiB memory, 16 Gbps networking) Configuration Diagrams ====================== 1) storage2020-20241015-00103.config1.png (see SPECstorage Solution 2020 results webpage) Component Software ================== Item Name and No Component Type Version Description ---- ------------ ------------ ------------ ----------------------------------- 1 WekaFS File System Version 4.3. The WEKA filesystem (WekaFS) 5.109-azure redefines storage solutions with its software-only approach, WekaFS addresses common storage challenges by removing performance bottlenecks, making it suitable for environments requiring low latency, high performance, and cloud scalability. 2 Weka Server Storage OS Ubuntu 20.04 Operating System (OS) for 100 storage virtual machines using Azure L32s v3 instances 3 Clients Client OS Ubuntu 20.04 Operating System (OS) for 64 client virtual machines using Azure E32s v5 instances Hardware Configuration and Tuning - Virtual =========================================== +----------------------------------------------------------------------+ | Component Name | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- Accelerated Enabled L32s and E32s virtual machines have 16 Networking Gbps connectivity Hardware Configuration and Tuning Notes --------------------------------------- None Software Configuration and Tuning - Virtual =========================================== +----------------------------------------------------------------------+ | Networking | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- Jumbo Frames 3900 Enables Ethernet jumbo frames up to 3900 bytes Software Configuration and Tuning Notes --------------------------------------- The single filesystem was attached via a single mount per client. Four WEKA front ends (cores) were used on the clients. Note that this system was deployed entirely using WEKA's Terraform Module. You can create a Terraform template from WEKA's Cloud Deployment Manager at https://cloud.weka.io. Clients automount the WekaFS filesystem when the Terraform deployment completes. Service SLA Notes ----------------- None Storage and Filesystems ======================= Item Stable No Description Data Protection Storage Qty ---- ------------------------------------- ------------------ -------- ----- 1 Weka Filesystem with 682TB of usable WEKA 16+2 Local 400 storage distributed data 1.92TB protection NVMe Disk Number of Filesystems 1 Total Capacity 682 TB Filesystem Type WekaFS Filesystem Creation Notes ------------------------- Each storage backend has four Azure SSDs attached to it, which are dedicated to the WEKA filesystem created. The storage cluster consisted of 100 storage servers with a single WEKA filesystem created in the cluster. Each client mounted the WEKA filesystem with a single mount. Storage and Filesystem Notes ---------------------------- Three cores assigned to the FE clients, which is specified in the Terraform configuration file. Transport Configuration - Virtual ================================= Item Number of No Transport Type Ports Used Notes ---- --------------- ---------- ----------------------------------------------- 1 16 Gbps Virtual 100 Used by Weka Backend Server Nodes Nic 2 16 Gbps Virtual 64 Used by Weka Frontend Client Nodes Nic Transport Configuration Notes ----------------------------- None Switches - Virtual ================== Total Used Item Port Port No Switch Name Switch Type Count Count Notes ---- -------------------- --------------- ------ ----- ------------------------ 1 Azure 16 Gbps 100 100 Used by Weka Backend Ethernet with Server Nodes Accelerated Networking 2 Azure 16 Gbps 64 64 Used by Weka Frontend Ethernet with Client Nodes Accelerated Networking Processing Elements - Virtual ============================= Item No Qty Type Location Description Processing Function ---- ---- -------- -------------- ------------------------- ------------------- 1 3200 vCPU L32s v3 Weka 2.8 GHz Intel(R) Xeon(R) WekaFS, Network Backend Platinum 8370C processors Communications, Storage Functions 2 2048 vCPU E32s v5 Weka 2.8 GHz Intel(R) Xeon(R) WekaFS, Network Frontend Platinum 8370C processors Communications, Storage Functions Processing Element Notes ------------------------ None Memory - Virtual ================ Size in Number of Description GiB Instances Nonvolatile Total GiB ------------------------- ---------- ---------- ------------ ------------ Azure L32s v3 Virtual 256 100 V 25600 Machine Memory Azure E32s v5 Virtual 256 64 V 16384 Machine Memory Grand Total Memory Gibibytes 41984 Memory Notes ------------ None Stable Storage ============== WekaFS does not use any internal memory to temporarily cache write data to the underlying storage system. All writes are committed directly to the storage disks and protected via WekaFS Distributed Data Protection (16+2 in this case). There is no need for any RAM battery protection. In an event of a power failure a write in transit would not be acknowledged. Solution Under Test Configuration Notes ======================================= The solution under test was a standard distributed cluster built with Weka software. Weka clusters can handle large and small file I/O with intensive metadata operations for HPC applications with no tuning required. Other Solution Notes ==================== None Dataflow ======== None Other Notes =========== None Other Report Notes ================== None =============================================================================== Generated on Fri Oct 18 03:32:56 2024 by SpecReport Copyright (C) 2016-2024 Standard Performance Evaluation Corporation