SPECstorage™ Solution 2020_ai_image ResultCopyright © 2016-2024 Standard Performance Evaluation Corporation |
WEKAIO, Inc. | SPECstorage Solution 2020_ai_image = 700 AI_Jobs |
---|---|
WEKA - Public Cloud Reference | Overall Response Time = 0.85 msec |
|
WEKA - Public Cloud Reference | |
---|---|
Tested by | WEKAIO, Inc. | Hardware Available | January 2024 | Software Available | January 2024 | Date Tested | January 2024 | License Number | 4553 | Licensee Locations | Campbell, CA USA |
The WEKA; Data Platform is purpose-built to seamlessly and sustainably deliver speed, simplicity, and scale that meets the needs of modern enterprises and research organizations without compromise. Its advanced, software-defined architecture supports next-generation workloads in virtually any location with cloud simplicity and on-premises performance.
Item No | Qty | Type | Vendor | Model/Name | Description |
---|---|---|---|---|---|
1 | 64 | Azure Virtual Machine | Azure | Standard L8sv3 | WEKA storage back ends - Azure Standard L8s v3 Virtual Machine (8 vCPUs, 64 GiB memory, 12.5 Gbps networking) |
2 | 16 | Azure Virtual Machine | Azure | Standard D64sv3 | Ubuntu clients with WEKA POSIX-compliant filesystem driver - Azure Standard D64s v3 Virtual Machine (64 vCPUs, 256 GiB memory, 30 Gbps networking) |
Item No | Component | Type | Name and Version | Description |
---|---|---|---|---|
1 | WekaFS | File System | Version 4.2.7.64 | The WEKA filesystem (WekaFS) redefines storage solutions with its software-only approach and addresses common storage challenges by removing performance bottlenecks, making it suitable for environments requiring low latency, high performance, and cloud scalability. |
2 | Weka Backend Node | Storage OS | Ubuntu 20.04 | Operating System (OS) for 50 storage virtual machines using Azure L8sv3 instances" |
3 | Clients | Client OS | Ubuntu 20.04 | Operating System (OS) for 13 client virtual machines using Azure D64sv3 instances" |
Component Name | Parameter Name | Value | Description |
---|---|---|
Accelerated Networking | Enabled | L8s instances have 12.5 Gbps and D64s instances have 30 Gbps connectivity |
None
Networking | Parameter Name | Value | Description |
---|---|---|
Jumbo Frames | 3900 | WekaFS recommended MTU for Azure. |
num_cores | 3 | WekaFS mount option to designate the number of frontend cores to allocate for the client. |
The single filesystem was attached via a single mount per client. The mount string used was "mount -t wekafs -o net=enP19658s5np0/10.0.0.56/20/10.0.0.1 -o net=enP28661s2np0/10.0.0.64/20/10.0.0.1 -o net=enP31350s3np0/10.0.0.63/20/10.0.0.1 -o num_cores=3 -o mgmt_ip=10.0.0.76 10.0.0.60/default /mnt/weka" The mount specifies that 3 WEKA front ends (cores) were used on the clients.
None
Item No | Description | Data Protection | Stable Storage | Qty |
---|---|---|---|---|
1 | WEKA Filesystem with 88TB of usable storage | WEKA 16+2 distributed data protection | Local 1.92TB NVMe Disk | 64 |
Number of Filesystems | 1 | Total Capacity | 88 TB | Filesystem Type | WekaFS |
---|
Each storage backend has one Azure SSD attached to it, which are dedicated to the WEKA filesystem created . The storage cluster consisted of 64 storage servers with a single WEKA filesystem created in the cluster. Each client mounted the WEKA filesystem with a single mount.
None
Item No | Transport Type | Number of Ports Used | Notes |
---|---|---|---|
1 | 12.5 Gbps Virtual Nic | 64 | Used by WEKA Backend Server Nodes |
2 | 30 Gbps Virtual Nic | 16 | Used by WEKA Frontend Client Nodes |
None
Item No | Switch Name | Switch Type | Total Port Count | Used Port Count | Notes |
---|---|---|---|---|---|
1 | Azure | 12.5 Gbps Ethernet with Accelerated Networking | 64 | 64 | Used by WEKA Backend Server Nodes |
2 | Azure | 30 Gbps Ethernet with Accelerated Networking | 16 | 16 | Used by WEKA Frontend Client Nodes |
Item No | Qty | Type | Location | Description | Processing Function |
---|---|---|---|---|---|
1 | 512 | vCPU | L8sv3 WEKA Backend | 2.8 GHz Intel(R) Xeon(R) Platinum 8370C processors | WekaFS, Network Communications, Storage Functions |
2 | 1024 | vCPU | D64sv3 WEKA Frontend | 2.8 GHz Intel(R) Xeon(R) Platinum 8370C processors | WekaFS, Network Communications, Storage Functions |
None
Description | Size in GiB | Number of Instances | Nonvolatile | Total GiB |
---|---|---|---|---|
Azure L8sv3 Virtual Machine Memory | 64 | 64 | V | 4096 |
Azure D64sv3 Virtual Machine Memory | 256 | 16 | V | 4096 | Grand Total Memory Gibibytes | 8192 |
None
WekaFS does not use any internal memory to temporarily cache write data to the underlying storage system. All writes are commited directly to the storage disk, and protected via WekaFS Distributed Data Protection (16+2 in this case). There is no need for any RAM battery protection. In an event of a power failure a write in transit would not be acknowledged.
The system under test consisted of 16 x D64sv3 Azure client virtual machines and 64 x L8sv3 backend virtual machines. Each client has a 30Gbps network connection and each WEKA backend has 12.5Gbps network connection.
None
None
None
The solution under test was a standard WekaFS cluster in dedicated server mode. The solution will handle both large file I/O as well as small file random I/O and metadata intensive applications. No specialized tuning is required for different or mixed use workloads. None of the components used to perform the test were patched with Spectre or Meltdown patches (CVE-2017-5754, CVE-2017-5753, CVE-2017-5715).
Generated on Thu Feb 15 10:31:28 2024 by SpecReport
Copyright © 2016-2024 Standard Performance Evaluation Corporation