SPECsfs2008_nfs.v3 Result

Throughput (ops/sec) Response (msec) 29435 0.6 58907 0.7 88372 0.8 117878 1.0 147284 1.2 177021 1.6 206422 1.9 236207 2.5 265729 3.4 293128 6.4

Tested By	Hitachi Data Systems
Product Name	Hitachi NAS Platform, Model 4100, Dual Node Cluster
Hardware Available	July 2013
Software Available	July 2013
Date Tested	June 2013
SFS License Number	276
Licensee Locations	Santa Clara, CA, USA

The Hitachi Unified Storage (HUS) and Hitachi NAS (HNAS) Platform family of products provide multiprotocol support to store and share block, file and object data types. The 4000 series delivers best-in-class performance, scalability, clustering with automated failover, 99.999% availability, non-disruptive upgrades, smart primary deduplication, intelligent file tiering, automated migration, 256TB file system pools, a single namespace up to the maximum usable capacity and are integrated with the Hitachi Command suite of management and data protection software. The Hitachi NAS Platform uses a hardware-accelerated "Hybrid Core" architecture that accelerates network and file protocol processing to achieve the industry's best performance in terms of both throughput and Operations per second. The HNAS uses an object-based file system (SiliconFS) and virtualization to deliver the highest scalability in the market, enabling organizations to consolidate file servers and other NAS devices into fewer nodes and storage arrays for simplified management, improved space efficiency and lower energy consumption. Each 4100 node can scale up 16PB of usable data storage; support 10GbE LAN access and 8Gbps FC storage connectivity.

Item No	Qty	Type	Vendor	Model/Name	Description
1	2	Server	HDS	SX345373.P	Hitachi NAS 4100 Base System
2	1	Server	HDS	SX345278.P	System Management Unit (SMU)
3	2	Software	HDS	SX365131.P	Hitachi NAS SW - Software Bundle
4	8	FC Interface	HDS	FTLF8528P3BNV.P	SFP+ 8Gbps FC
5	12	Network Interface	HDS	FTLX8571D3BCV.P	SFP+ 10GE
6	1	Storage	HDS	VSP-SOLUTION.S	Virtual Storage Platform
7	1	Storage	HDS	VSP-A0001.S	VSP Hardware Product
8	1	Disk Controller	HDS	DKC710I-CBXA.P	Primary Controller Chassis
9	1	Disk Controller	HDS	DKC710I-CBXB.P	Second Controller Chassis
10	16	Cache	HDS	DKC-F710I-C32G.P	Cache Memory Module (32GB)
11	8	Cache	HDS	DKC-F710I-BM64.P	Cache Flash Memory Module (used only during Power outage)
12	480	Disk Drives	HDS	DKC-F710I-146KCM.P	SFF 146GB Disk Drive 2.5inch
13	4	Drive Chassis	HDS	DKC-F710I-SBX.P	SFF Drive Chassis
14	2	FC Interface	HDS	DKC-F710I-16UFC.P	Fibre 16-Port HOST Adapter(8Gbps)
15	4	Disk Adapter	HDS	DKC-F710I-SCA.P	Disk Adapter
16	4	Processor Blade	HDS	DKC-F710I-MP.P	Processor Blade
17	2	Switch Adapter	HDS	DKC-F710I-ESW.P	PCI-Express Switch Adapter
18	2	Hub	HDS	DKC-F710I-HUB.P	Hub Kit
19	2	Rack	HDS	DKC-F710I-RK42.P	Rack - 42U
20	3	Software	HDS	044-230001-03.P	VSP Basic Operating System 20TB Base License
21	1	Software	HDS	044-230001-04B.P	VSP Basic Operating System 4-VSD Pair Base License
22	2	Switch	Brocade	HD-5320-0008.P	Brocade 5320 switch

OS Name and Version	11.2.3319.04
Other Software	None
Filesystem Software	SiliconFS 11.2.3319.04

Name	Value	Description
security-mode	UNIX	Security mode is native UNIX
cifs_auth	off	Disable CIFS security authorization
cache-bias	small-files	Set metadata cache bias to small files
fs-accessed-time	off	Accessed time management was turned off
shortname	off	Disable short name generation for CIFS clients
read-ahead	0	Disable file read-ahead

Server Tuning Notes

None

Description	Number of Disks	Usable Size
146GB SAS 15K RPM Disks	480	47.1 TB
250GB SATA Disks. These four drives (two mirrored drives per node) are used for storing the core operating system and management logs. No cache or data storage.	4	500.0 GB
Total	484	47.6 TB

Number of Filesystems	8
Total Exported Capacity	47.07 TB
Filesystem Type	WFS-2
Filesystem Creation Options	4K filesystem block size
Filesystem Config	Each Filesystem was striped across 15 x 3D+1P RAID-5 LUNs (60 HDDs).
Fileset Size	34445.3 GB

The storage configuration consisted of one Virtual Storage Platform storage system (VSP) configured with dual chassis and up to 512GB cache memory. There were 480 15K RPM SAS disks in use for these tests. There were 120 LUNs created using RAID-5, 3D+1P. There were eight 8Gbps FC ports in use across 2 FED features located in different clusters. The FC ports were connected to the 4100 nodes via a redundant pair of Brocade 5320 switches. The 4100 nodes were connected to each Brocade 5320 switch via two 8Gbps FC connections, such that a completely redundant path exists from each node to the storage. The Hitachi NAS Platform 4100 nodes have two internal mirrored hard disk drives which are used to store the core operating software and system logs. These drives are not used for cache space or for storing data.

Item No	Network Type	Number of Ports Used	Notes
1	10 Gigabit Ethernet	4	Integrated 10GbE Ethernet controller

Network Configuration Notes

Two 10GbE network interfaces from each 4100 node were connected to a Brocade TurboIron 24X switch, which provided network connectivity to the clients. The interfaces were configured to use Jumbo frames.

Each LG has an Intel XF SR 10GbE single port PCIe network interface. Each LG connects via a single 10GbE connection to the ports on the Brocade TurboIron 24X network switch.

Item No	Qty	Type	Description	Processing Function
1	2	FPGA	Altera Stratix IV EP4SE530	Filesystem
2	6	FPGA	Altera Stratix IV EP4SGX360	Network Interface, Storage Interface, NFS
3	2	CPU	Intel Xeon Quad-Core CPU	Management
4	8	VSD	Intel XeonQuad-Core CPU	VSP unit

Processing Element Notes

Each 4100 node has 4 FPGAs that are used for processing functions.The VSD is the VSP's I/O processor board. There are two pairs of these installed per chassis. Each board includes an Intel Xeon Quad-Core CPU.

Description	Size in GB	Number of Instances	Total GB	Nonvolatile
Server Main Memory	32	2	64	V
Server Filesystem and Storage Cache	68	2	136	V
Server Battery-backed NVRAM	8	2	16	NV
Cache Memory Module(VSP)	32	16	512	NV
Grand Total Memory Gigabytes			728

Memory Notes

Each 4100 node has 32GB of main memory that is used for the operating system and in support of the FPGA functions. 68GB of memory is dedicated to filesystem metadata, sector cache and for other purposes. A separate, integrated battery-backed NVRAM module (8GB) on the filesystem board is used to provide stable storage for writes that have not yet been written to disk. The VSP storage system was configured with 512GB Memory.

The Hitachi NAS Platform node writes to the battery based (72 hours) NVRAM internal to the Server first. The data from NVRAM is then written to the backend storage system at the earliest opportunity, but always within a few seconds of arrival in the NVRAM. In an active-active cluster configuration, the contents of the NVRAM are synchronously mirrored to ensure that in the event of a single node failover, any pending transactions can be completed by the remaining node. The data from the node is then written onto the battery backed backend storage system cache (a second layer of NVRAM in the entire solution) and are backed up onto the Cache Flash Memory modules in the event of a power outage. The Cache Flash Memory modules in the backend storage system are part of the total solution, but is used only during power outage and not used as cache space.

The system under test consisted of two Hitachi NAS Platform 4100 nodes, connected to a VSP storage system via two Brocade 5320 FC switches. The nodes are configured in an active-active cluster mode, directly connected by a redundant pair of 10GbE connections to the cluster interconnect ports. The VSP storage system consisted of 480 15K RPM SAS drives. All the connectivity from server to the storage was via two 8Gbps switched FC fabric. For these tests, there were 2 zones created on each FC switch. Each 4100 server was connected to each zone via 2 integrated 8Gbps FC ports (corresponding to 2 H-ports). The VSP storage system was connected to the 2 zones (corresponding to 8 FC ports) providing I/O path from the server to storage. The System Management Unit (SMU) is part of the total system solution, but is used for management purposes only and was not active during the test.

None

Item No	Qty	Vendor	Model/Name	Description
1	15	Oracle	Sun Fire x2200	RHEL 5 clients, two Dual core processors, 8GB RAM
2	1	Brocade	TurboIron	Brocade TurboIron 24X, 24 port 10GbE Switch

LG Type Name	LG1
BOM Item #	1
Processor Name	AMD Opteron
Processor Speed	2.6 GHz
Number of Processors (chips)	2
Number of Cores/Chip	2
Memory Size	8 GB
Operating System	Red Hat Enterprise Linux 5, 2.6.18-8.e15 kernel.
Network Type	1 x Intel XF SR PCIe 10GbE

Benchmark Parameters

Network Attached Storage Type	NFS V3
Number of Load Generators	15
Number of Processes per LG	136
Biod Max Read Setting	2
Biod Max Write Setting	2
Block Size	64

Testbed Configuration

LG No	LG Type	Network	Target Filesystems	Notes
62..76	LG1	1	/w/d0, /w/d1, /w/d2, /w/d3, /w/d4, /w/d5, /w/d6, /w/d7	None

Load Generator Configuration Notes

All clients were connected to one common namespace on the server cluster, connected to a single 10GbE network.

Each load generating client hosted 136 processes, all accessing a single namespace on the 4100 cluster through a common network connection. There were 8 target file systems (/w/d0, /w/d1, /w/d2, /w/d3, /w/d4, /w/d5, /w/d6, /w/d7) that are presented as a single cluster namespace through virtual root (/w), accessible to all clients. Each load generator was mounted to each filesystem target (/w/d0, /w/d1, /w/d2, /w/d3, /w/d4, /w/d5, /w/d6, /w/d7) and cycled through all the filesystems in sequence.

Other test notes: None

Hitachi Unified Storage, Hitachi Unified Storage VM, Hitachi NAS Platform and Virtual Storage Platform are registered trademarks of Hitachi Data Systems, Inc. in the United States, other countries, or both. All other trademarks belong to their respective owners and should be treated as such.

• Configuration Diagram