SPECsfs97_R1.v3 Result

EMC Corp. :	Celerra/CX600
SPECsfs97_R1.v3 =	30549 Ops/Sec (Overall Response Time = 3.13 msec)

Performance

Throughput (ops/sec)	Response (msec)
2974	1.3
6049	1.4
9110	1.8
12029	2.2
15077	2.6
18202	3.1
21227	3.5
24288	4.3
27364	5.6
30549	10.4

Configuration

Server Configuration and Availability
Vendor	EMC Corp.
Hardware Available	October 2002
Software Available	October 2002
Date Tested	October 2002
SFS License Number	47
Licensee Locations	Hopkinton, MA

CPU, Memory and Power

Model Name Celerra/CX600

Processor 866 MHz Pentium III

# of Processors 4 (2 per node, 2 nodes)

Primary Cache 16KBI+16KBD on chip

Secondary Cache 256KB(I+D) on chip

Other Cache N/A

UPS N/A

Other Hardware 1 507 Control Station, 1 EMC DS-16B2 FC Switch

Memory Size 6GB (3 GB per node)

NVRAM Size NA

NVRAM Type NA

NVRAM Description NA

Server Software

OS Name and Version DART 5.0.9.3026

Other Software N/A

File System UxFS

NFS version 3

Server Tuning

Buffer Cache Size Dynamic

# NFS Processes 156 (per node)

Fileset Size 290.1 GB

Network Subsystem
Network Type	Jumbo Gigabit Ethernet
Network Controller Desc.	Alteon AceNIC
Number Networks	2 (N1,N2)
Number Network Controllers	4 (2 per node)
Protocol Type	TCP

Switch Type Cisco 6509 Gigabit Ethernet

Bridge Type N/A

Hub Type N/A

Other Network Hardware N/A

Disk Subsystem and Filesystems

Number Disk Controllers (4 (2 cards/2 ports per card)) per node

Number of Disks 139

Number of Filesystems 2 (fs1,fs2)

File System Creation Ops default

File System Config striped(64K),across 130 RAID-1 luns

Disk Controller Emulex LP9002DC-F2 Fibre Channel

# of Controller Type 2

Number of Disks 139

Disk Type Seagate Cheetah 73GB 10K RPM

File Systems on Disks OS(5)RAID-5,UxFSlog(4)RAID-1,fs1(130)RAID-1 (nos. in parens refer to phys. disks)

Special Config Notes 6.94 GB cache, 3.47GB (Write-2.00GB,Read-1.47GB) per dual storage processor,each cache is battery backed up for write thru when there is a system component failure, see notes

Load Generator (LG) Configuration
Number of Load Generators	12
Number of Processes per LG	26
Biod Max Read Setting	5
Biod Max Write Setting	5

LG Type LG1

LG Model Sun Sparc 220R

Number and Type Processors 2x450 MHz Sparc

Memory Size 512 MB

Operating System 2x450 MHz Sparc

Compiler Sun Forte 6.2

Compiler Options None

Network Type Intraserver Gbe

LG Type LG2

LG Model Sun Sparc 420R

Number and Type Processors 2x450 MHz Sparc

Memory Size 1 GB

Operating System Solaris 2.8

Compiler Sun Forte 6.2

Compiler Options None

Network Type Intraserver Gbe

Testbed Configuration

LG # LG Type Network Target File Systems Notes

1 LG1 N1 /fs1, /fs2, /fs1, /fs2,...../fs1, /fs2 N/A

2 LG1 N1 /fs1, /fs2, /fs1, /fs2,...../fs1, /fs2 N/A

3 LG1 N1 /fs1, /fs2, /fs1, /fs2,...../fs1, /fs2 N/A

4 LG1 N1 /fs1, /fs2, /fs1, /fs2,...../fs1, /fs2 N/A

5 LG2 N1 /fs1, /fs2, /fs1, /fs2,...../fs1, /fs2 N/A

6 LG2 N2 /fs1, /fs2, /fs1, /fs2,...../fs1, /fs2 N/A

7 LG1 N1 /fs1, /fs2, /fs1, /fs2,...../fs1, /fs2 N/A

8 LG2 N2 /fs1, /fs2, /fs1, /fs2,...../fs1, /fs2 N/A

9 LG1 N2 /fs1, /fs2, /fs1, /fs2,...../fs1, /fs2 N/A

10 LG1 N2 /fs1, /fs2, /fs1, /fs2,...../fs1, /fs2 N/A

11 LG2 N2 /fs1, /fs2, /fs1, /fs2,...../fs1, /fs2 N/A

12 LG2 N2 /fs1, /fs2, /fs1, /fs2,...../fs1, /fs2 N/A

Testbed Configuration
LG #	LG Type	Network	Target File Systems	Notes
1	LG1	N1	/fs1, /fs2, /fs1, /fs2,...../fs1, /fs2	N/A
2	LG1	N1	/fs1, /fs2, /fs1, /fs2,...../fs1, /fs2	N/A
3	LG1	N1	/fs1, /fs2, /fs1, /fs2,...../fs1, /fs2	N/A
4	LG1	N1	/fs1, /fs2, /fs1, /fs2,...../fs1, /fs2	N/A
5	LG2	N1	/fs1, /fs2, /fs1, /fs2,...../fs1, /fs2	N/A
6	LG2	N2	/fs1, /fs2, /fs1, /fs2,...../fs1, /fs2	N/A
7	LG1	N1	/fs1, /fs2, /fs1, /fs2,...../fs1, /fs2	N/A
8	LG2	N2	/fs1, /fs2, /fs1, /fs2,...../fs1, /fs2	N/A
9	LG1	N2	/fs1, /fs2, /fs1, /fs2,...../fs1, /fs2	N/A
10	LG1	N2	/fs1, /fs2, /fs1, /fs2,...../fs1, /fs2	N/A
11	LG2	N2	/fs1, /fs2, /fs1, /fs2,...../fs1, /fs2	N/A
12	LG2	N2	/fs1, /fs2, /fs1, /fs2,...../fs1, /fs2	N/A

Other Notes

Server tuning:
param ufs inoHashTableSize=646413 (inode hash table size)
param ufs inoBlkHashSize=129287 (inode block hash size)
param ufs updateAccTime=0 (disable access time updates)
param ufs withoutCollector=1 (enable NFS-to-CPU thread affinity)
file initialize nodes=646400(inode cache) dnlc=880000(dir. name lookup cache)
ace ace0 offload (offload IP checksum calc. to the NIC)
ace ace1 offload (offload IP checksum calc. to the NIC)
ap pgoff (turn page bounds checking off)
nfs start openfiles=413696(openfile cache) nfsd=156(no. of nfs demon procs.)
The ufslog size is 1 GB per node or filesystem
Client tuning:
ndd -set /dev/tcp tcp_recv_hiwat 65536
ndd -set /dev/tcp tcp_xmit_hiwat 65536
ndd -set /dev/tcp tcp_cwnd_max 2097152
ndd -set /dev/tcp tcp_max_buf 4194304
Storage array notes:
The storage array, whose product name is the CX600, exposes luns
across multiple fibre ports. Each data lun is 5GB in size.
Four fibre ports are connected to the fibre switch and
the 4 Emulex ports on the data mover. Each physical
disk is configured as 2 logical LUNs. Each filesystem
is built on a 64K stripe that spans across 65 RAID-1
luns, and all 130 physical disks. The net result is that
each client can access each lun.
The cache configured in the CX600 storage array which has
dual storage processor units that work as an active-active-
failover pair. The cache is backed up with a battery unit
capable of saving the write cache to disk prior to a power
failure. In the event of a storage array failure, the
second unit is capable of saving all state that was managed
by the first (and vise versa), even with a simultaneous
power failure. Whenever one of the storage processors or
the battery units are off-line, the system turns
off the write cache and writes directly to disk before
acknowledging any write operations.
The length of time the battery can support the retention
of data is 2 minutes - that is sufficient to write all
necessary data twice. Storage processor A could have written
99% of its memory to disk and then fail. In that case
SP B has enough battery to store its copy of A's data as
well as its own.

First published at SPEC.org on 12-Nov-2002

LG Type	LG1
LG Model	Sun Sparc 220R
Number and Type Processors	2x450 MHz Sparc
Memory Size	512 MB
Operating System	2x450 MHz Sparc
Compiler	Sun Forte 6.2
Compiler Options	None
Network Type	Intraserver Gbe

LG Type	LG2
LG Model	Sun Sparc 420R
Number and Type Processors	2x450 MHz Sparc
Memory Size	1 GB
Operating System	Solaris 2.8
Compiler	Sun Forte 6.2
Compiler Options	None
Network Type	Intraserver Gbe