SPEC Seal of Reviewal SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation
CommuniGate Pro Dynamic Cluster with BlueArc & Intel SPECmail2001 msgs/min = 10,000
SPEC license # 000078 Tested by:
CommuniGate Systems		 Test date:
Jun-2005		 Hardware Avail:
Feb-2005		 Software Avail:
Jun-2005

10,000 SPECmail2001 messages per minute is equivalent to 2,000,000 SPECmail2001_users.

Detail Summary | General Notes
System configurations: CommuniGate Pro Dynamic Cluster - Backend Servers | High Speed Network File Server for Main Mail Storage | CommuniGate Pro Dynamic Cluster - Frontend Servers | Load generator | Sink | Benchmark Manager/DNS Servers | Configuration diagram
Detailed results: Detailed Results 80% load | Detailed Results 100% load | Detailed Results 120% load


Summary Results
Function Response
time limit
(seconds)		 Required
Percentage
Compliant		 Percentage Compliant
80% 100% 120%
SMTP Connect 5 >95% 100.00% 100.00% 100.00%
SMTP Data 5 >95% 99.98% 99.99% 99.99%
POP Connect 5 >95% 100.00% 100.00% 100.00%
POP Status 5 >95% 100.00% 100.00% 100.00%
POP Retrieve 5 >95% 100.00% 100.00% 100.00%
POP Delete 5 >95% 100.00% 100.00% 100.00%
Delivery Time 60 >95% 99.03% 99.00% 98.97%
Error Rate NA <1% 0.00% 0.00% 0.00%

CommuniGate Pro Dynamic Cluster - Backend Servers (4 systems)
Software
CommuniGate Pro: CommuniGate Pro v4.3.6 Operating System: Sun Solaris 10 x86
Availability: Jun-2005 File System: UFS for the OS, NFS for the message store
Hardware
Vendor: Intel CPU: Intel Xeon x86_64 (Potomac)
Model Name: Intel SR6850HW4 4CPU Xeon (Potomac) CPU MHz: 3325
Availability: Feb-2005 CPUs Enabled: 4
Disk Subsystem: Internal 36GB SCSI disk for the OS, NFS file server for the message store Primary Cache: 16K
Memory (MB): 16384 Secondary Cache: 1024K
Network: Intel NetXtreme BCM5704 Gigabit Ethernet Other Cache: 8MB
# of Systems: 4 Other: HyperThreading is disabled in the BIOS
Notes / Tuning Information 
CommuniGate Pro Backend Servers
Sun Solaris 10 x86, patched to current
Tuning:
ulimit -n 65535
ndd -set /dev/tcp tcp_recv_hiwat 65536
ndd -set /dev/tcp tcp_xmit_hiwat 65536
ndd -set /dev/tcp tcp_conn_req_max_q 512
ndd -set /dev/tcp tcp_conn_req_max_q0 5120
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 135000
ndd -set /dev/tcp tcp_time_wait_interval 60000
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_keepalive_interval 30000
/etc/system:
set rlim_fd_cur=8192
set rlim_fd_max=65536
set maxusers=4096
NFS mount options:
192.168.64.112:/CommuniGate on /data type nfs remote/read/write/setuid/devices/bg/hard/intr/proto=tcp/rsize=32768/wsize=32768/timeo=600/vers=3/xattr/dev=4700008 on Wed Jun 29 22:16:54 2005
Backend Server temporary directory mounted on a 2GB /tmpfs partition.
This is a temporary partition on the Backend Servers for temporary files that, in a failure,
would be stored to stable storage on the Frontend Servers. This method is a fully safe and RFC-compliant setup for production use.
swap on /tmpfs type tmpfs read/write/setuid/devices/xattr/size=2048m/dev=4480005 on Tue Jun 21 16:51:29 2005

High Speed Network File Server for Main Mail Storage (1 system)
Software
BOS: BlueArc OS 4.0.824n Operating System: Firmware 4.0.824n
Availability: May-2005 File System: SiliconFS
Hardware
Vendor: BlueArc CPU: One MPC 7457B + 7 FPGAs (CPU manufacturer is Freescale/Motorola)
Model Name: BlueArc Titan32 Silicon Server CPU MHz: 1264
Availability: Jan-2004 CPUs Enabled: 1
Disk Subsystem: 140 146GB 10kRPM FC disks Primary Cache: 32KBI + 32KBD on chip
Memory (MB): 14GB Secondary Cache: 512KB(I+D) on chip
Network: 4x 1 Gb Ethernet Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information 
Four (4) 2882 controller modules (each with two (2) redundant Raid Controllers) and
112 10kRPM FC disks in eight (8) RAID5 stripes including eight (8) hot spares for the
CGPro Backend Servers shared storage, exported as 192.168.64.112:/CommuniGate.
28 10kRPM FC disks in two (2) RAID5 stripes including two (2) hot spares for the
CGPro Frontend Servers shared storage, exported as 192.168.64.112:/vol1.

CommuniGate Pro Dynamic Cluster - Frontend Servers (4 systems)
Software
CommuniGate Pro: CommuniGate Pro v4.3.6 Operating System: Sun Solaris 10 x86
Availability: Jun-2005 File System: UFS for the OS, NFS for the message store
Hardware
Vendor: Amax CPU: Intel Xeon x86
Model Name: Amax Rackplex 1U 2x Xeon U320 Server CPU MHz: 2800
Availability: Mar-2004 CPUs Enabled: 2
Disk Subsystem: Internal 40GB 7200RPM IDE for the OS, NFS file server for the message store Primary Cache: 8K
Memory (MB): 2048 Secondary Cache: 512K
Network: Gb Ethernet Other Cache: N/A
# of Systems: 4 Other: HyperThreading is disabled in the BIOS
Notes / Tuning Information 
CommuniGate Pro Frontend Servers
Sun Solaris 10 x86, patched to current
Tuning:
ulimit -n 65535
ndd -set /dev/tcp tcp_recv_hiwat 65536
ndd -set /dev/tcp tcp_xmit_hiwat 65536
ndd -set /dev/tcp tcp_conn_req_max_q 512
ndd -set /dev/tcp tcp_conn_req_max_q0 5120
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 135000
ndd -set /dev/tcp tcp_time_wait_interval 60000
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_keepalive_interval 30000
/etc/system:
set rlim_fd_cur=8192
set rlim_fd_max=65536
set maxusers=4096
NFS mount options:
192.168.64.112:/vol1 on /data type nfs remote/read/write/setuid/devices/bg/hard/intr/proto=tcp/rsize=32768/wsize=32768/timeo=600/vers=3/xattr/dev=4700003 on Wed Jun 29 22:16:53 2005

Load generator (8 systems)
Software
JVM: Sun Java J2RE 1.4.2_08 (no JIT) Operating System: SunOS 5.8 Generic_108528-18
Availability: Apr-2001 File System: UFS
Hardware
Vendor: Sun CPU: UltraSPARC IIIi
Model Name: Sun v210 CPU MHz: 1002
Availability: Aug-2002 CPUs Enabled: 2
Disk Subsystem: Ultra160 SCSI 36GB Primary Cache: 32K
Memory (MB): 2048 Secondary Cache: 1MB
Network: Gb Ethernet Other Cache: N/A
# of Systems: 8 Other: N/A
Notes / Tuning Information 
N/A

Sink (3 systems)
Software
JVM: Sun Java J2RE 1.4.2_08 (no JIT) Operating System: Fedora Core 1
Availability: Apr-2001 File System: ext3
Hardware
Vendor: Amax CPU: Intel Xeon x86
Model Name: Amax Rackplex 1U 2x Xeon U320 Server CPU MHz: 2800
Availability: Mar-2004 CPUs Enabled: 2
Disk Subsystem: Diskless systems, booted from NFS server Primary Cache: 8K
Memory (MB): 1024 Secondary Cache: 512K
Network: Gb Ethernet Other Cache: N/A
# of Systems: 3 Other: N/A
Notes / Tuning Information 
N/A

Benchmark Manager/DNS Servers (2 systems)
Software
JVM: Sun Java J2RE 1.4.2_08 (no JIT) Operating System: RedHat Release 9
Availability: Apr-2001 File System: ext3
Hardware
Vendor: Amax CPU: Intel Xeon x86
Model Name: Amax Rackplex 1U 2x Xeon U320 Server CPU MHz: 2800
Availability: Mar-2004 CPUs Enabled: 2
Disk Subsystem: 1 x 40GB 7200RPM IDE, ReiserFS filesystem Primary Cache: 8K
Memory (MB): 1024 Secondary Cache: 512K
Network: Gb Ethernet Other Cache: N/A
# of Systems: 2 Other: N/A
Notes / Tuning Information 
BIND 9.2.1 DNS Server on both systems


Detailed Results -- 80% Load
Load User Count Message Rate
(msg/min)
Attempted 1,600,000 8,000
Actual 1,599,600 7,998
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 911,637 911,637 100.00%
SMTP Hello 911,640 911,640 100.00%
SMTP Mail From 911,641 911,409 99.97%
SMTP Rcpt To 1,826,706 1,826,706 100.00%
SMTP Data 911,638 911,452 99.98%
SMTP Quit 902,473 902,473 100.00%
POP Connect 959,832 959,832 100.00%
POP User ID 959,834 959,834 100.00%
POP Password 959,843 959,534 99.97%
POP Status 959,848 959,848 100.00%
POP Retrieve 953,842 953,842 100.00%
POP Delete 951,295 951,295 100.00%
POP Quit 957,390 957,390 100.00%
Delivery Time 9,216 9,127 99.03%
SMTP Data Response Time 911,638 902,400 98.99%
POP Retrieve Response Time 953,842 952,528 99.86%
Remote Message Delivery 862,674 853,985 98.99%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 9,164
SMTP Session 902,473
SMTP To Local 964,028
SMTP To Remote 862,674
SINK Connect Error 0
POP Connect Error 0
POP Protocol Error 0
POP Disconnect 2,540
POP Session 957,390
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 429 9.64
SMTP Hello 0 449 22.42
SMTP Mail From 0 5,778 29.68
SMTP Rcpt To 0 443 17.46
SMTP Data 0 6,555 37.41
SMTP Quit 0 432 16.00
POP Connect 0 403 17.23
POP User ID 0 432 39.43
POP Password 2 8,031 123.21
POP Status 0 636 24.31
POP Retrieve 0 438 24.46
POP Delete 0 563 24.27
POP Quit 0 430 26.99
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.53
POP Retrieve (KB down) 1 2,675 24.48


Detailed Results -- 100% Load
Load User Count Message Rate
(msg/min)
Attempted 2,000,000 10,000
Actual 2,001,400 10,007
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 1,140,124 1,140,124 100.00%
SMTP Hello 1,140,124 1,140,124 100.00%
SMTP Mail From 1,140,121 1,139,102 99.91%
SMTP Rcpt To 2,286,827 2,286,827 100.00%
SMTP Data 1,140,158 1,140,008 99.99%
SMTP Quit 1,128,666 1,128,666 100.00%
POP Connect 1,201,475 1,201,475 100.00%
POP User ID 1,201,475 1,201,475 100.00%
POP Password 1,201,477 1,200,584 99.93%
POP Status 1,201,469 1,201,469 100.00%
POP Retrieve 1,194,466 1,194,466 100.00%
POP Delete 1,191,308 1,191,308 100.00%
POP Quit 1,198,219 1,198,219 100.00%
Delivery Time 11,269 11,156 99.00%
SMTP Data Response Time 1,140,158 1,128,565 98.98%
POP Retrieve Response Time 1,194,466 1,192,758 99.86%
Remote Message Delivery 1,084,118 1,073,152 98.99%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 11,492
SMTP Session 1,128,666
SMTP To Local 1,202,703
SMTP To Remote 1,084,118
SINK Connect Error 0
POP Connect Error 4
POP Protocol Error 0
POP Disconnect 3,153
POP Session 1,198,223
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 513 9.96
SMTP Hello 0 566 23.12
SMTP Mail From 0 7,354 32.85
SMTP Rcpt To 0 583 17.74
SMTP Data 0 8,600 42.49
SMTP Quit 0 536 16.02
POP Connect 0 503 17.71
POP User ID 0 840 39.65
POP Password 2 9,561 150.24
POP Status 0 560 24.33
POP Retrieve 0 542 24.74
POP Delete 0 552 24.45
POP Quit 0 559 27.94
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.44
POP Retrieve (KB down) 1 2,675 24.56


Detailed Results -- 120% Load
Load User Count Message Rate
(msg/min)
Attempted 2,400,000 12,000
Actual 2,398,800 11,994
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 1,367,007 1,367,007 100.00%
SMTP Hello 1,367,006 1,367,006 100.00%
SMTP Mail From 1,367,004 1,365,754 99.91%
SMTP Rcpt To 2,737,466 2,737,466 100.00%
SMTP Data 1,366,977 1,366,801 99.99%
SMTP Quit 1,353,135 1,353,135 100.00%
POP Connect 1,439,668 1,439,668 100.00%
POP User ID 1,439,671 1,439,671 100.00%
POP Password 1,439,681 1,438,674 99.93%
POP Status 1,439,683 1,439,683 100.00%
POP Retrieve 1,439,024 1,439,024 100.00%
POP Delete 1,435,208 1,435,208 100.00%
POP Quit 1,435,667 1,435,667 100.00%
Delivery Time 13,676 13,535 98.97%
SMTP Data Response Time 1,366,977 1,353,016 98.98%
POP Retrieve Response Time 1,439,024 1,436,941 99.86%
Remote Message Delivery 1,294,292 1,280,944 98.97%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 13,843
SMTP Session 1,353,135
SMTP To Local 1,443,175
SMTP To Remote 1,294,292
SINK Connect Error 0
POP Connect Error 8
POP Protocol Error 0
POP Disconnect 3,821
POP Session 1,435,675
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 665 10.48
SMTP Hello 0 829 23.97
SMTP Mail From 0 7,559 47.85
SMTP Rcpt To 0 1,233 18.37
SMTP Data 0 8,722 61.71
SMTP Quit 0 692 16.22
POP Connect 0 680 18.41
POP User ID 0 990 40.38
POP Password 2 10,442 198.22
POP Status 0 1,316 24.25
POP Retrieve 0 692 25.31
POP Delete 0 2,500 24.77
POP Quit 0 721 28.94
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.60
POP Retrieve (KB down) 1 2,675 24.93

General Notes / Tuning Information 
CommuniGate Pro configuration:
Queue Foldering: 100
Enqueuer Processors: 50
Dequeuer Processors: 10
TextMailBox mailbox option (default)
Index Mailboxes larger than: 100 Kbytes
SMTP Channels: 7500
SMTP Channels/Host: 50
LOCAL Processes: 10 (Backends)
LOCAL Processes: 300 (Frontends)
LOCAL Flow Control: unlimited
POP Channels: 50000
IMAP Channels: 50000
PWD Channels: 50
Cluster Domains->Account Storage->Foldering Method: Hashed 2 Levels
Cluster Domains->Account Storage->Generate Index: Yes
Backend Servers: Queue Processing->Submit Messages: Remotely (all SMTP submitted to Frontend queues)
Frontend Servers: Queue Processing->Submit Messages: Locally for Others (all SMTP delivered from Frontend queues)

CommuniGate Pro startup options:
--DefaultStackSize 131072 --useNonBlockingSockets --closeStuckSockets --CreateTempFilesDirectly 10
--ClusterBackend  # Backends
--ClusterFrontend # Frontends

Networking:
Cisco 3750 Switch for server connectivity
Cisco 6506 Switch with Sup 720 for BlueArc Titan connectivity

This benchmark was performed at the BlueArc lab in San Jose, California.

For questions about this result, please contact the tester.
For other inquiries, please contact webmaster@spec.org
Copyright © 1999-2001 Standard Performance Evaluation Corporation

First published at SPEC.org on 29-Jul-2005

Benchmark run on Fri Jul 01 19:23:08 PDT 2005 by SPECmail2001 v1.01
Report generated on Mon Aug 15 17:30:30 EDT 2005 by SPECmail2001 v1.05 HTML Formatter