SPECsfs97_R1.v3 Result

EMC Corp :	Celerra NS40G Cluster 2 X-Blades
SPECsfs97_R1.v3 =	76068 Ops/Sec (Overall Response Time = 1.83 msec)

Performance

Throughput (ops/sec)	Response (msec)
7522	0.6
15129	0.8
22659	1.1
30298	1.3
37890	1.6
45679	1.9
53161	2.1
60855	2.5
68546	3.2
76068	6.4

Configuration

Server Configuration and Availability
Vendor	EMC Corp
Hardware Available	October 2006
Software Available	October 2006
Date Tested	November 2006
SFS License Number	47
Licensee Locations	Hopkinton, MA

CPU, Memory and Power

Model Name Celerra NS40G Cluster 2 X-Blades

Processor 2.8 GHz Intel Pentium 4 (Nocona)

# of Processors 4 cores, 4 chips, 1 core/chip with HT Technology enabled (2 chips per blade)

Primary Cache 16KB Data + 12K instruction uOPs

Secondary Cache 1MB (unified)

Other Cache N/A

UPS N/A

Other Hardware EMC DS_4100B 4 Gbit Fibre Channel Switch. See the NS40G Datamover to CX3-40 Storage Array Connectivity notes below.

Memory Size 8 GB (4GB per X-blade)

NVRAM Size N/A

NVRAM Type N/A

NVRAM Description N/A

Server Software

OS Name and Version DART 5.5.22.2

Other Software N/A

File System N/A

NFS version 3

Server Tuning

Buffer Cache Size Dynamic

# NFS Processes 4

Fileset Size 725.3 GB

Network Subsystem
Network Type	Jumbo Gigabit Ethernet
Network Controller Desc.	Gigabit Ethernet Controller
Number Networks	1
Number Network Controllers	4 (2 of 4 per X-blade)
Protocol Type	TCP

Switch Type Cisco 6500 Gbit Switch (Jumbo)

Bridge Type N/A

Hub Type N/A

Other Network Hardware N/A

Disk Subsystem and Filesystems

Number Disk Controllers 2

Number of Disks 240

Number of Filesystems 1

File System Creation Ops N/A

File System Config N/A

Disk Controller Integrated 4 Gb Fibre Channel

# of Controller Type 4 (2 per SP)

Number of Disks 120

Disk Type 15K RPM 300 GB Fibre Channel (part # 005048619)

File Systems on Disks File system fs1 (120 disks), File system fs2 (120 disks), UxFS log shares 5 disks with fs1

Special Config Notes 4 GB cache per CX3-40 SP, 2 pairs of CX3-40 SP's. (Configured as 2500 MB Mirrored write cache per SP pair, 516 MB read cache per

Load Generator (LG) Configuration
Number of Load Generators	12
Number of Processes per LG	36
Biod Max Read Setting	5
Biod Max Write Setting	5

LG Type LG1

LG Model Dell PowerEdge 1750

Number and Type Processors 2 x 3.06 GHz Intel P4 Xeon

Memory Size 2 GB

Operating System Linux 2.2.21-4smp

Compiler GCC 3.2.3

Compiler Options -O

Network Type Broadcom BCM5704 NetXtreme Gigabit Ethernet

Testbed Configuration

LG # LG Type Network Target File Systems Notes

1 LG1 1 /fs1, /fs2, ..., /fs1, /fs2 N/A

2 LG1 1 /fs1, /fs2, ..., /fs1, /fs2 N/A

3 LG1 1 /fs1, /fs2, ..., /fs1, /fs2 N/A

4 LG1 1 /fs1, /fs2, ..., /fs1, /fs2 N/A

5 LG1 1 /fs1, /fs2, ..., /fs1, /fs2 N/A

6 LG1 1 /fs1, /fs2, ..., /fs1, /fs2 N/A

7 LG1 1 /fs1, /fs2, ..., /fs1, /fs2 N/A

8 LG1 1 /fs1, /fs2, ..., /fs1, /fs2 N/A

9 LG1 1 /fs1, /fs2, ..., /fs1, /fs2 N/A

10 LG1 1 /fs1, /fs2, ..., /fs1, /fs2 N/A

11 LG1 1 /fs1, /fs2, ..., /fs1, /fs2 N/A

12 LG1 1 /fs1, /fs2, ..., /fs1, /fs2 N/A

Testbed Configuration
LG #	LG Type	Network	Target File Systems	Notes
1	LG1	1	/fs1, /fs2, ..., /fs1, /fs2	N/A
2	LG1	1	/fs1, /fs2, ..., /fs1, /fs2	N/A
3	LG1	1	/fs1, /fs2, ..., /fs1, /fs2	N/A
4	LG1	1	/fs1, /fs2, ..., /fs1, /fs2	N/A
5	LG1	1	/fs1, /fs2, ..., /fs1, /fs2	N/A
6	LG1	1	/fs1, /fs2, ..., /fs1, /fs2	N/A
7	LG1	1	/fs1, /fs2, ..., /fs1, /fs2	N/A
8	LG1	1	/fs1, /fs2, ..., /fs1, /fs2	N/A
9	LG1	1	/fs1, /fs2, ..., /fs1, /fs2	N/A
10	LG1	1	/fs1, /fs2, ..., /fs1, /fs2	N/A
11	LG1	1	/fs1, /fs2, ..., /fs1, /fs2	N/A
12	LG1	1	/fs1, /fs2, ..., /fs1, /fs2	N/A

Other Notes

Server tuning:
param ufs inoBlkHashSize=170669 (inode block hash size)
param ufs inoHashTableSize=1218761 (inode hash table size)
param ufs updateAccTime=0 (disable access-time updates)
param nfs withoutCollector=1 (enable NFS-to-CPU thread affinity)
param file prefetch=0 (disable DART read prefetch)
param mkfsArgs dirType=DIR_COMPAT (Compatability mode directory style)
param kernel maxStrToBeProc=16 (no. of network streams to process at once)
param kernel outerLoop=8 (8 consecutive iterations of network packets processing)
param kernel buffersWatermarkPercentage=5 (flushing buffer cache threshold)
file initialize nodes=1000000 dnlc=1656000 (no. of inodes, no. of dirctory name lookup cache entries)
nfs start openfiles=980462 nfsd=4 (no. of open files and 4 NFS daemons)
param ufs nFlushCyl=32 (no. of UxFS cylinder group blocks flush threads)
param ufs nFlushDir=32 (no. of UxFS directory and indirect blocks flush threads)
param ufs nFlushIno=32 (no. of UxFS inode blocks flush threads)
Storage array notes:
Each CX3-40 used for storage exposes LUNs across multiple Fibre ports.
Each LUN is configured 4+1 RAID 5 on 5 physical drives. Each LUN is 30720MB in size.
Each of the 4 CX3-40 SP's has 4GB of memory. 2500 MB write cache was configured
per SP pair. The write cache is mirrored between the CX3-40 SP's. 516 MB
read cache was configured on each CX3-40 SP.
The memory is backed up with sufficient battery power to safely destage all cached
data in the write cache onto the disk in the event of a power failure.
NS40G Datamover to CX3-40 Storage Array Connectivity notes:
Each NS40G X-blade has 2 Fibre Channel ports connected to the DS-4100B switch.
The switch is zoned so the first Fibre Channel port of the NS40G X-blade accesses the
first port of each of the CX3-40 SPs (4 SP's). The second Fibre Channel port of the
X-blade access the second port of each of the CX3-40 SP's. There is
one X-blade Fibre Channel port and 1 CX3-40 Fibre Channel port in each zone on
the DS-4100B switch.

First published at SPEC.org on 06-Dec-2006

LG Type	LG1
LG Model	Dell PowerEdge 1750
Number and Type Processors	2 x 3.06 GHz Intel P4 Xeon
Memory Size	2 GB
Operating System	Linux 2.2.21-4smp
Compiler	GCC 3.2.3
Compiler Options	-O
Network Type	Broadcom BCM5704 NetXtreme Gigabit Ethernet