SPECmail2001 Result: CommuniGate Pro Dynamic Cluster with BlueArc & Intel

SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation

CommuniGate Pro Dynamic Cluster with BlueArc & Intel

SPECmail2001 msgs/min = 12,500

SPEC license # 000078

Tested by:
CommuniGate Systems

Test date:
Jul-2005

Hardware Avail:
Feb-2005

Software Avail:
Jun-2005

12,500 SPECmail2001 messages per minute is equivalent to 2,500,000 SPECmail2001_users.

Summary Results
Function	Response time limit (seconds)	Required Percentage Compliant	Percentage Compliant
Function	Response time limit (seconds)	Required Percentage Compliant	80%	100%	120%
SMTP Connect	5	>95%	100.00%	100.00%	100.00%
SMTP Data	5	>95%	99.98%	99.98%	99.93%
POP Connect	5	>95%	100.00%	100.00%	100.00%
POP Status	5	>95%	100.00%	100.00%	100.00%
POP Retrieve	5	>95%	100.00%	100.00%	100.00%
POP Delete	5	>95%	100.00%	100.00%	100.00%
Delivery Time	60	>95%	99.05%	99.09%	63.73%
Error Rate	NA	<1%	0.00%	0.00%	0.00%

CommuniGate Pro Dynamic Cluster - Backend Servers (4 systems)

Software
CommuniGate Pro:	CommuniGate Pro v4.3.6	Operating System:	Sun Solaris 10 x86
Availability:	Jun-2005	File System:	UFS for the OS, NFS for the message store

Hardware
Vendor:	Intel	CPU:	Intel Xeon x86_64 (Potomac)
Model Name:	Intel SR6850HW4 4CPU Xeon (Potomac)	CPU MHz:	3325
Availability:	Feb-2005	CPUs Enabled:	4
Disk Subsystem:	Internal 36GB SCSI disk for the OS, NFS file server for the message store	Primary Cache:	16K
Memory (MB):	16384	Secondary Cache:	1024K
Network:	Intel NetXtreme BCM5704 Gigabit Ethernet	Other Cache:	8MB
# of Systems:	4	Other:	HyperThreading is disabled in the BIOS

Notes / Tuning Information

CommuniGate Pro Backend Servers
Sun Solaris 10 x86, patched to current
Tuning:
ulimit -n 65535
ndd -set /dev/tcp tcp_recv_hiwat 65536
ndd -set /dev/tcp tcp_xmit_hiwat 65536
ndd -set /dev/tcp tcp_conn_req_max_q 512
ndd -set /dev/tcp tcp_conn_req_max_q0 5120
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 135000
ndd -set /dev/tcp tcp_time_wait_interval 60000
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_keepalive_interval 30000
/etc/system:
set rlim_fd_cur=8192
set rlim_fd_max=65536
set maxusers=4096
NFS mount options:
192.168.64.112:/CommuniGate on /data type nfs remote/read/write/setuid/devices/bg/hard/intr/proto=tcp/rsize=32768/wsize=32768/timeo=600/vers=3/xattr/dev=4700008 on Wed Jun 29 22:16:54 2005
Backend Server temporary directory mounted on a 2GB /tmpfs partition.
This is a temporary partition on the Backend Servers for temporary files that, in a failure,
would be stored to stable storage on the Frontend Servers. This method is a fully safe and RFC-compliant setup for production use.
swap on /tmpfs type tmpfs read/write/setuid/devices/xattr/size=2048m/dev=4480005 on Tue Jun 21 16:51:29 2005

High Speed Network File Server for Main Mail Storage (1 system)

Software
BOS:	BlueArc OS 4.0.824n	Operating System:	Firmware 4.0.824n
Availability:	May-2005	File System:	SiliconFS

Hardware
Vendor:	BlueArc	CPU:	One MPC 7457B + 7 FPGAs (CPU manufacturer is Freescale/Motorola)
Model Name:	BlueArc Titan32 Silicon Server	CPU MHz:	1264
Availability:	Jan-2004	CPUs Enabled:	1
Disk Subsystem:	140 146GB 10kRPM FC disks	Primary Cache:	32KBI + 32KBD on chip
Memory (MB):	14GB	Secondary Cache:	512KB(I+D) on chip
Network:	4x 1 Gb Ethernet	Other Cache:	N/A
# of Systems:	1	Other:	N/A

Notes / Tuning Information

Five (5) 2882 controller modules (each with two (2) redundant Raid Controllers) and
112 10kRPM FC disks in eight (8) RAID5 stripes including eight (8) hot spares for the
CGPro Backend Servers shared storage, exported as 192.168.64.112:/CommuniGate.
28 10kRPM FC disks in two (2) RAID5 stripes including two (2) hot spares for the
CGPro Frontend Servers shared storage, exported as 192.168.64.112:/vol1.

CommuniGate Pro Dynamic Cluster - Frontend Servers (5 systems)

Software
CommuniGate Pro:	CommuniGate Pro v4.3.6	Operating System:	Sun Solaris 10 x86
Availability:	Jun-2005	File System:	UFS for the OS, NFS for the message store

Hardware
Vendor:	Amax	CPU:	Intel Xeon x86
Model Name:	Amax Rackplex 1U 2x Xeon U320 Server	CPU MHz:	2800
Availability:	Mar-2004	CPUs Enabled:	2
Disk Subsystem:	Internal 40GB 7200RPM IDE for the OS, NFS file server for the message store	Primary Cache:	8K
Memory (MB):	2048	Secondary Cache:	512K
Network:	Gb Ethernet	Other Cache:	N/A
# of Systems:	5	Other:	HyperThreading is disabled in the BIOS

Notes / Tuning Information

CommuniGate Pro Frontend Servers
Sun Solaris 10 x86, patched to current
Tuning:
ulimit -n 65535
ndd -set /dev/tcp tcp_recv_hiwat 65536
ndd -set /dev/tcp tcp_xmit_hiwat 65536
ndd -set /dev/tcp tcp_conn_req_max_q 512
ndd -set /dev/tcp tcp_conn_req_max_q0 5120
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 135000
ndd -set /dev/tcp tcp_time_wait_interval 60000
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_keepalive_interval 30000
/etc/system:
set rlim_fd_cur=8192
set rlim_fd_max=65536
set maxusers=4096
NFS mount options:
192.168.64.112:/vol1 on /data type nfs remote/read/write/setuid/devices/bg/hard/intr/proto=tcp/rsize=32768/wsize=32768/timeo=600/vers=3/xattr/dev=4700003 on Wed Jun 29 22:16:53 2005

Load generator (10 systems)

Software
JVM:	Sun Java J2RE 1.4.2_08 (no JIT)	Operating System:	SunOS 5.8 Generic_108528-18
Availability:	Apr-2001	File System:	UFS

Hardware
Vendor:	Sun	CPU:	UltraSPARC IIIi
Model Name:	Sun v210	CPU MHz:	1002
Availability:	Aug-2002	CPUs Enabled:	2
Disk Subsystem:	Ultra160 SCSI 36GB	Primary Cache:	32K
Memory (MB):	2048	Secondary Cache:	1MB
Network:	Gb Ethernet	Other Cache:	N/A
# of Systems:	10	Other:	N/A

Notes / Tuning Information
N/A

Sink (3 systems)

Software
JVM:	Sun Java J2RE 1.4.2_08 (no JIT)	Operating System:	Fedora Core 1
Availability:	Apr-2001	File System:	ext3

Hardware
Vendor:	Amax	CPU:	Intel Xeon x86
Model Name:	Amax Rackplex 1U 2x Xeon U320 Server	CPU MHz:	2800
Availability:	Mar-2004	CPUs Enabled:	2
Disk Subsystem:	Diskless systems, booted from NFS server	Primary Cache:	8K
Memory (MB):	1024	Secondary Cache:	512K
Network:	Gb Ethernet	Other Cache:	N/A
# of Systems:	3	Other:	N/A

Notes / Tuning Information
N/A

Benchmark Manager/DNS Servers (2 systems)

Software
JVM:	Sun Java J2RE 1.4.2_08 (no JIT)	Operating System:	RedHat Release 9
Availability:	Apr-2001	File System:	ext3

Hardware
Vendor:	Amax	CPU:	Intel Xeon x86
Model Name:	Amax Rackplex 1U 2x Xeon U320 Server	CPU MHz:	2800
Availability:	Mar-2004	CPUs Enabled:	2
Disk Subsystem:	1 x 40GB 7200RPM IDE, ReiserFS filesystem	Primary Cache:	8K
Memory (MB):	1024	Secondary Cache:	512K
Network:	Gb Ethernet	Other Cache:	N/A
# of Systems:	2	Other:	N/A

Notes / Tuning Information
BIND 9.2.1 DNS Server on both systems

General Notes / Tuning Information
CommuniGate Pro configuration: Queue Foldering: 100 Enqueuer Processors: 50 Dequeuer Processors: 10 TextMailBox mailbox option (default) Index Mailboxes larger than: 300 Kbytes SMTP Channels: 7500 SMTP Channels/Host: 50 LOCAL Processes: 10 (Backends) LOCAL Processes: 500 (Frontends) LOCAL Flow Control: unlimited POP Channels: 50000 IMAP Channels: 50000 PWD Channels: 50 Cluster Domains->Account Storage->Foldering Method: Hashed 2 Levels Cluster Domains->Account Storage->Generate Index: Yes Backend Servers: Queue Processing->Submit Messages: Remotely (all SMTP submitted to Frontend queues) Frontend Servers: Queue Processing->Submit Messages: Locally for Others (all SMTP delivered from Frontend queues) CommuniGate Pro startup options: --DefaultStackSize 131072 --useNonBlockingSockets --closeStuckSockets --CreateTempFilesDirectly 10 --ClusterBackend # Backends --ClusterFrontend # Frontends Networking: Cisco 3750 Switch for server connectivity Cisco 6506 Switch with Sup 720 for BlueArc Titan connectivity This benchmark was performed at the BlueArc lab in San Jose, California.

General Notes / Tuning Information

CommuniGate Pro configuration:
Queue Foldering: 100
Enqueuer Processors: 50
Dequeuer Processors: 10
TextMailBox mailbox option (default)
Index Mailboxes larger than: 300 Kbytes
SMTP Channels: 7500
SMTP Channels/Host: 50
LOCAL Processes: 10 (Backends)
LOCAL Processes: 500 (Frontends)
LOCAL Flow Control: unlimited
POP Channels: 50000
IMAP Channels: 50000
PWD Channels: 50
Cluster Domains->Account Storage->Foldering Method: Hashed 2 Levels
Cluster Domains->Account Storage->Generate Index: Yes
Backend Servers: Queue Processing->Submit Messages: Remotely (all SMTP submitted to Frontend queues)
Frontend Servers: Queue Processing->Submit Messages: Locally for Others (all SMTP delivered from Frontend queues)

CommuniGate Pro startup options:
--DefaultStackSize 131072 --useNonBlockingSockets --closeStuckSockets --CreateTempFilesDirectly 10
--ClusterBackend  # Backends
--ClusterFrontend # Frontends

Networking:
Cisco 3750 Switch for server connectivity
Cisco 6506 Switch with Sup 720 for BlueArc Titan connectivity

This benchmark was performed at the BlueArc lab in San Jose, California.

First published at SPEC.org on 29-Jul-2005

Benchmark run on Thu Jul 07 03:29:09 PDT 2005 by SPECmail2001 v1.01
Report generated on Mon Aug 15 17:30:30 EDT 2005 by SPECmail2001 v1.05 HTML Formatter