SPECstorage™ Solution 2020_ai_image Result
Copyright © 2016-2020 Standard Performance Evaluation Corporation
|
SPECstorage™ Solution 2020_ai_image ResultCopyright © 2016-2020 Standard Performance Evaluation Corporation |
| SPECstorage(TM) Subcommittee | SPECstorage Solution 2020_ai_image = 190 AI_Jobs |
|---|---|
| Reference Submission in the Public Cloud | Overall Response Time = 1.26 msec |
|
|
| Reference Submission in the Public Cloud | |
|---|---|
| Tested by | SPECstorage(TM) Subcommittee | Hardware Available | November 2020 | Software Available | October 2020 | Date Tested | November 2020 | License Number | 4553 | Licensee Locations | Campbell, California |
Weka has developed a software-defined storage architecture that offers complete hardware independence while delivering an extremely performant solution that offers the flexibility of multiple protocol support. The design philosophy behind the Weka file system (WekaFS) was to create a single storage architecture, that runs on industry standard servers or on instances in the public cloud, with the performance of all-flash arrays, the simplicity and feature set of network-attached storage (NAS), and the scalability and economics of the cloud. At the heart of the design is WekaFS, a fully distributed, parallel file system that was written entirely from scratch to deliver the highest-performance file and object services leveraging NVMe flash as its primary storage tier between the application and the storage. Internally, and transparent to the application layer, the software seamlessly expands the namespace to a hard disk drive (HDD) layer built on any S3 compliant object storage system.
| Item No | Qty | Type | Vendor | Model/Name | Description |
|---|---|---|---|---|---|
| 1 | 8 | AWS EC2 Instances | AWS | c5n.9xlarge | Amazon C5n EC2 instances are ideal for high compute applications (including High Performance Computing (HPC) workloads, data lakes, and network appliances, c5n.9xlarge instances have 36 vCPU, 96GiB of memory, 50Gbps networking |
| 2 | 8 | AWS EC2 Instances | AWS | i3en.12xlarge | Amazon i3en family of EC2 instances provides dense Non-Volatile Memory Express (NVMe)SSD instance storage optimized for low latency, high random I/O performance, high sequential disk throughput, i3en.12xlarge instances have 48 vCPU, 384GiB of memory, 4x7500GB NVMe SSDs, 50Gbps networking |
| Item No | Component | Type | Name and Version | Description |
|---|---|---|---|---|
| 1 | WekaFS | File System | Version 3.8.3 | WekaFS is a parallel and distributed POSIX compliant file system that scales across NVMe enabled compute nodes, creating a single storage cluster that delivers high performance access to data. Each node in the cluster contains equal amount of data and metadata for optimal parallel file access and performance. |
| 2 | Amazon Linux AMI | Operating System | Version 2017.09 | The Amazon Linux AMI is a supported and maintained Linux image provided by Amazon Web Services for use on Amazon Elastic Compute Cloud (Amazon EC2).It is deployed on the 8 i3en.12xlarge storage nodes. |
| 3 | Amazon Linux 2 | Operating System | Version 2017.09 | Amazon Linux 2 is the next generation of Amazon Linux, from Amazon Web Services (AWS). It is deployed on the 8 c5n.9xlarge compute nodes. |
| Storage Nodes | Parameter Name | Value | Description |
|---|---|---|
| SR-IOV | Enabled | Enables CPU virtualization technology |
SR-IOV was enabled on EC2 instance BIOS. No additional hardware tuning was required. The MTU is required and valid for all environments.
| Component Name | Parameter Name | Value | Description |
|---|---|---|
| Jumbo Frames | 9001 | Enables jumbo frames up to 9001 bytes of Ethernet frames |
None
AWS uses commercially reasonable efforts to make the Included Products and Services each available with a Monthly Uptime Percentage of at least 99.99%, in each case during any monthly billing cycle. (Monthly Uptime Percentage) is calculated by subtracting from 100% the percentage of minutes during the month in which any of the Included Products and Services, as applicable, was in the state of "Region Unavailable".
| Item No | Description | Data Protection | Stable Storage | Qty |
|---|---|---|---|---|
| 1 | Amazon EC2 i3en.12xlarge instances with WekaFS as a shared file system, each with 4 x 7,500GB NVMe SSDs | 4+2 | Yes | 8 |
| Number of Filesystems | 1 | Total Capacity | 98 TiB | Filesystem Type | WekaFS |
|---|
WekaFS is deployed on Amazon through a cloud formation template that can be launched from Marketplace. The Weka software is installed and the file system is configured as part of the cloud formation process. No additional file system creation steps are required.
None
| Item No | Transport Type | Number of Ports Used | Notes |
|---|---|---|---|
| 1 | 50Gbps Ethernet Virtual NIC | 16 | Virtual network |
None
| Item No | Switch Name | Switch Type | Total Port Count | Used Port Count | Notes |
|---|---|---|---|---|---|
| 1 | AWS | 50Gbs Ethernet with Enhanced Networking | 16 | 16 | Virtual network |
| Item No | Qty | Type | Location | Description | Processing Function |
|---|---|---|---|---|---|
| 1 | 384 | vCPU | i3en.12xlarge storage instances | 3.1 GHz all core turbo Intel® Xeon® Scalable (Skylake) processors | WekaFS, RAID, Network communication, Storage functions |
| 2 | 288 | vCPU | c5n.9xlarge client instances | 3.0 GHz Intel® Xeon® Platinum processors | WekaFS Client and benchmark |
None
| Description | Size in GiB | Number of Instances | Nonvolatile | Total GiB |
|---|---|---|---|---|
| AWS EC2 i3en.12xlarge instance memory | 384 | 8 | V | 3072 |
| AWS EC2 c5n.9xlarge instance memory | 96 | 8 | V | 768 | Grand Total Memory Gibibytes | 3840 |
None
WekaFS uses the EC2 instances which provide stable storage. The data is journeled as well as UPS protected across multiple layers of the AWS infrastructure.
The solution under test was a standard WekaFS enabled cluster in dedicated server mode. The solution will handle both large file I/O as well as small file random I/O and metadata intensive applications. No specialized tuning is required for different or mixed use workloads. None of the components used to perform the test were patched with Spectre or Meltdown patches
None
None
None
None
Generated on Thu Dec 17 10:40:40 2020 by SpecReport
Copyright © 2016-2020 Standard Performance Evaluation Corporation
