SPEC Seal of Reviewal SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation
CommuniGate Pro Dynamic Cluster with BlueArc & Intel SPECmail2001 msgs/min = 12,500
SPEC license # 000078 Tested by:
CommuniGate Systems		 Test date:
Jul-2005		 Hardware Avail:
Feb-2005		 Software Avail:
Jun-2005

12,500 SPECmail2001 messages per minute is equivalent to 2,500,000 SPECmail2001_users.

Detail Summary | General Notes
System configurations: CommuniGate Pro Dynamic Cluster - Backend Servers | High Speed Network File Server for Main Mail Storage | CommuniGate Pro Dynamic Cluster - Frontend Servers | Load generator | Sink | Benchmark Manager/DNS Servers | Configuration diagram
Detailed results: Detailed Results 80% load | Detailed Results 100% load | Detailed Results 120% load


Summary Results
Function Response
time limit
(seconds)		 Required
Percentage
Compliant		 Percentage Compliant
80% 100% 120%
SMTP Connect 5 >95% 100.00% 100.00% 100.00%
SMTP Data 5 >95% 99.98% 99.98% 99.93%
POP Connect 5 >95% 100.00% 100.00% 100.00%
POP Status 5 >95% 100.00% 100.00% 100.00%
POP Retrieve 5 >95% 100.00% 100.00% 100.00%
POP Delete 5 >95% 100.00% 100.00% 100.00%
Delivery Time 60 >95% 99.05% 99.09% 63.73%
Error Rate NA <1% 0.00% 0.00% 0.00%

CommuniGate Pro Dynamic Cluster - Backend Servers (4 systems)
Software
CommuniGate Pro: CommuniGate Pro v4.3.6 Operating System: Sun Solaris 10 x86
Availability: Jun-2005 File System: UFS for the OS, NFS for the message store
Hardware
Vendor: Intel CPU: Intel Xeon x86_64 (Potomac)
Model Name: Intel SR6850HW4 4CPU Xeon (Potomac) CPU MHz: 3325
Availability: Feb-2005 CPUs Enabled: 4
Disk Subsystem: Internal 36GB SCSI disk for the OS, NFS file server for the message store Primary Cache: 16K
Memory (MB): 16384 Secondary Cache: 1024K
Network: Intel NetXtreme BCM5704 Gigabit Ethernet Other Cache: 8MB
# of Systems: 4 Other: HyperThreading is disabled in the BIOS
Notes / Tuning Information 
CommuniGate Pro Backend Servers
Sun Solaris 10 x86, patched to current
Tuning:
ulimit -n 65535
ndd -set /dev/tcp tcp_recv_hiwat 65536
ndd -set /dev/tcp tcp_xmit_hiwat 65536
ndd -set /dev/tcp tcp_conn_req_max_q 512
ndd -set /dev/tcp tcp_conn_req_max_q0 5120
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 135000
ndd -set /dev/tcp tcp_time_wait_interval 60000
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_keepalive_interval 30000
/etc/system:
set rlim_fd_cur=8192
set rlim_fd_max=65536
set maxusers=4096
NFS mount options:
192.168.64.112:/CommuniGate on /data type nfs remote/read/write/setuid/devices/bg/hard/intr/proto=tcp/rsize=32768/wsize=32768/timeo=600/vers=3/xattr/dev=4700008 on Wed Jun 29 22:16:54 2005
Backend Server temporary directory mounted on a 2GB /tmpfs partition.
This is a temporary partition on the Backend Servers for temporary files that, in a failure,
would be stored to stable storage on the Frontend Servers. This method is a fully safe and RFC-compliant setup for production use.
swap on /tmpfs type tmpfs read/write/setuid/devices/xattr/size=2048m/dev=4480005 on Tue Jun 21 16:51:29 2005

High Speed Network File Server for Main Mail Storage (1 system)
Software
BOS: BlueArc OS 4.0.824n Operating System: Firmware 4.0.824n
Availability: May-2005 File System: SiliconFS
Hardware
Vendor: BlueArc CPU: One MPC 7457B + 7 FPGAs (CPU manufacturer is Freescale/Motorola)
Model Name: BlueArc Titan32 Silicon Server CPU MHz: 1264
Availability: Jan-2004 CPUs Enabled: 1
Disk Subsystem: 140 146GB 10kRPM FC disks Primary Cache: 32KBI + 32KBD on chip
Memory (MB): 14GB Secondary Cache: 512KB(I+D) on chip
Network: 4x 1 Gb Ethernet Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information 
Five (5) 2882 controller modules (each with two (2) redundant Raid Controllers) and
112 10kRPM FC disks in eight (8) RAID5 stripes including eight (8) hot spares for the
CGPro Backend Servers shared storage, exported as 192.168.64.112:/CommuniGate.
28 10kRPM FC disks in two (2) RAID5 stripes including two (2) hot spares for the
CGPro Frontend Servers shared storage, exported as 192.168.64.112:/vol1.

CommuniGate Pro Dynamic Cluster - Frontend Servers (5 systems)
Software
CommuniGate Pro: CommuniGate Pro v4.3.6 Operating System: Sun Solaris 10 x86
Availability: Jun-2005 File System: UFS for the OS, NFS for the message store
Hardware
Vendor: Amax CPU: Intel Xeon x86
Model Name: Amax Rackplex 1U 2x Xeon U320 Server CPU MHz: 2800
Availability: Mar-2004 CPUs Enabled: 2
Disk Subsystem: Internal 40GB 7200RPM IDE for the OS, NFS file server for the message store Primary Cache: 8K
Memory (MB): 2048 Secondary Cache: 512K
Network: Gb Ethernet Other Cache: N/A
# of Systems: 5 Other: HyperThreading is disabled in the BIOS
Notes / Tuning Information 
CommuniGate Pro Frontend Servers
Sun Solaris 10 x86, patched to current
Tuning:
ulimit -n 65535
ndd -set /dev/tcp tcp_recv_hiwat 65536
ndd -set /dev/tcp tcp_xmit_hiwat 65536
ndd -set /dev/tcp tcp_conn_req_max_q 512
ndd -set /dev/tcp tcp_conn_req_max_q0 5120
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 135000
ndd -set /dev/tcp tcp_time_wait_interval 60000
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_keepalive_interval 30000
/etc/system:
set rlim_fd_cur=8192
set rlim_fd_max=65536
set maxusers=4096
NFS mount options:
192.168.64.112:/vol1 on /data type nfs remote/read/write/setuid/devices/bg/hard/intr/proto=tcp/rsize=32768/wsize=32768/timeo=600/vers=3/xattr/dev=4700003 on Wed Jun 29 22:16:53 2005

Load generator (10 systems)
Software
JVM: Sun Java J2RE 1.4.2_08 (no JIT) Operating System: SunOS 5.8 Generic_108528-18
Availability: Apr-2001 File System: UFS
Hardware
Vendor: Sun CPU: UltraSPARC IIIi
Model Name: Sun v210 CPU MHz: 1002
Availability: Aug-2002 CPUs Enabled: 2
Disk Subsystem: Ultra160 SCSI 36GB Primary Cache: 32K
Memory (MB): 2048 Secondary Cache: 1MB
Network: Gb Ethernet Other Cache: N/A
# of Systems: 10 Other: N/A
Notes / Tuning Information 
N/A

Sink (3 systems)
Software
JVM: Sun Java J2RE 1.4.2_08 (no JIT) Operating System: Fedora Core 1
Availability: Apr-2001 File System: ext3
Hardware
Vendor: Amax CPU: Intel Xeon x86
Model Name: Amax Rackplex 1U 2x Xeon U320 Server CPU MHz: 2800
Availability: Mar-2004 CPUs Enabled: 2
Disk Subsystem: Diskless systems, booted from NFS server Primary Cache: 8K
Memory (MB): 1024 Secondary Cache: 512K
Network: Gb Ethernet Other Cache: N/A
# of Systems: 3 Other: N/A
Notes / Tuning Information 
N/A

Benchmark Manager/DNS Servers (2 systems)
Software
JVM: Sun Java J2RE 1.4.2_08 (no JIT) Operating System: RedHat Release 9
Availability: Apr-2001 File System: ext3
Hardware
Vendor: Amax CPU: Intel Xeon x86
Model Name: Amax Rackplex 1U 2x Xeon U320 Server CPU MHz: 2800
Availability: Mar-2004 CPUs Enabled: 2
Disk Subsystem: 1 x 40GB 7200RPM IDE, ReiserFS filesystem Primary Cache: 8K
Memory (MB): 1024 Secondary Cache: 512K
Network: Gb Ethernet Other Cache: N/A
# of Systems: 2 Other: N/A
Notes / Tuning Information 
BIND 9.2.1 DNS Server on both systems


Detailed Results -- 80% Load
Load User Count Message Rate
(msg/min)
Attempted 2,000,000 10,000
Actual 1,999,600 9,998
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 1,138,784 1,138,784 100.00%
SMTP Hello 1,138,781 1,138,781 100.00%
SMTP Mail From 1,138,780 1,138,482 99.97%
SMTP Rcpt To 2,282,805 2,282,805 100.00%
SMTP Data 1,138,816 1,138,634 99.98%
SMTP Quit 1,127,404 1,127,404 100.00%
POP Connect 1,200,670 1,200,670 100.00%
POP User ID 1,200,676 1,200,676 100.00%
POP Password 1,200,712 1,200,283 99.96%
POP Status 1,200,711 1,200,711 100.00%
POP Retrieve 1,191,301 1,191,301 100.00%
POP Delete 1,188,120 1,188,120 100.00%
POP Quit 1,197,453 1,197,453 100.00%
Delivery Time 11,324 11,216 99.05%
SMTP Data Response Time 1,138,816 1,127,305 98.99%
POP Retrieve Response Time 1,191,301 1,189,657 99.86%
Remote Message Delivery 1,081,506 1,070,712 99.00%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 11,417
SMTP Session 1,127,404
SMTP To Local 1,201,296
SMTP To Remote 1,081,506
SINK Connect Error 0
POP Connect Error 6
POP Protocol Error 0
POP Disconnect 3,185
POP Session 1,197,459
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 3,364 9.66
SMTP Hello 0 581 22.45
SMTP Mail From 0 5,961 34.33
SMTP Rcpt To 0 573 17.69
SMTP Data 0 6,851 42.89
SMTP Quit 0 562 16.03
POP Connect 0 3,390 17.23
POP User ID 0 587 39.43
POP Password 2 7,571 114.92
POP Status 0 503 24.28
POP Retrieve 0 509 24.43
POP Delete 0 1,141 24.27
POP Quit 0 473 27.05
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.80
POP Retrieve (KB down) 1 2,675 24.44


Detailed Results -- 100% Load
Load User Count Message Rate
(msg/min)
Attempted 2,500,000 12,500
Actual 2,499,200 12,496
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 1,422,222 1,422,222 100.00%
SMTP Hello 1,422,225 1,422,225 100.00%
SMTP Mail From 1,422,183 1,419,739 99.83%
SMTP Rcpt To 2,841,353 2,841,353 100.00%
SMTP Data 1,422,188 1,421,853 99.98%
SMTP Quit 1,407,887 1,407,887 100.00%
POP Connect 1,502,036 1,502,036 100.00%
POP User ID 1,502,044 1,502,044 100.00%
POP Password 1,502,015 1,500,541 99.90%
POP Status 1,502,027 1,502,026 100.00%
POP Retrieve 1,485,686 1,485,686 100.00%
POP Delete 1,481,725 1,481,724 100.00%
POP Quit 1,498,022 1,498,022 100.00%
Delivery Time 14,249 14,120 99.09%
SMTP Data Response Time 1,422,188 1,407,673 98.98%
POP Retrieve Response Time 1,485,686 1,483,650 99.86%
Remote Message Delivery 1,342,988 1,329,684 99.01%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 14,299
SMTP Session 1,407,887
SMTP To Local 1,498,364
SMTP To Remote 1,342,988
SINK Connect Error 0
POP Connect Error 9
POP Protocol Error 1
POP Disconnect 3,955
POP Session 1,498,031
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 3,396 10.02
SMTP Hello 0 910 23.17
SMTP Mail From 0 7,823 48.43
SMTP Rcpt To 0 909 18.01
SMTP Data 0 9,191 56.58
SMTP Quit 0 986 16.09
POP Connect 0 3,400 17.70
POP User ID 0 862 39.72
POP Password 2 10,760 162.84
POP Status 0 5,156 24.44
POP Retrieve 0 548 24.87
POP Delete 0 5,499 24.58
POP Quit 0 542 28.24
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.45
POP Retrieve (KB down) 1 2,675 24.40


Detailed Results -- 120% Load
Load User Count Message Rate
(msg/min)
Attempted 3,000,000 15,000
Actual 3,000,600 15,003
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 1,709,795 1,709,795 100.00%
SMTP Hello 1,709,791 1,709,791 100.00%
SMTP Mail From 1,709,786 1,703,184 99.61%
SMTP Rcpt To 3,416,326 3,416,326 100.00%
SMTP Data 1,709,823 1,708,703 99.93%
SMTP Quit 1,692,732 1,692,732 100.00%
POP Connect 1,800,954 1,800,954 100.00%
POP User ID 1,800,956 1,800,956 100.00%
POP Password 1,801,029 1,794,657 99.65%
POP Status 1,801,008 1,801,000 100.00%
POP Retrieve 1,786,850 1,786,850 100.00%
POP Delete 1,782,137 1,782,088 100.00%
POP Quit 1,796,171 1,796,171 100.00%
Delivery Time 16,933 10,791 63.73%
SMTP Data Response Time 1,709,823 1,692,463 98.98%
POP Retrieve Response Time 1,786,850 1,784,361 99.86%
Remote Message Delivery 1,617,212 1,598,224 98.83%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 17,097
SMTP Session 1,692,731
SMTP To Local 1,799,114
SMTP To Remote 1,617,212
SINK Connect Error 0
POP Connect Error 56
POP Protocol Error 2
POP Disconnect 4,708
POP Session 1,796,227
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 3,391 11.07
SMTP Hello 0 2,099 24.84
SMTP Mail From 0 19,798 111.00
SMTP Rcpt To 0 1,902 19.62
SMTP Data 0 19,871 112.72
SMTP Quit 0 1,195 16.58
POP Connect 0 3,390 18.89
POP User ID 0 1,068 41.11
POP Password 2 31,832 376.71
POP Status 0 7,873 25.22
POP Retrieve 0 984 26.52
POP Delete 0 11,730 26.42
POP Quit 0 986 30.63
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.53
POP Retrieve (KB down) 1 2,675 24.66

General Notes / Tuning Information 
CommuniGate Pro configuration:
Queue Foldering: 100
Enqueuer Processors: 50
Dequeuer Processors: 10
TextMailBox mailbox option (default)
Index Mailboxes larger than: 300 Kbytes
SMTP Channels: 7500
SMTP Channels/Host: 50
LOCAL Processes: 10 (Backends)
LOCAL Processes: 500 (Frontends)
LOCAL Flow Control: unlimited
POP Channels: 50000
IMAP Channels: 50000
PWD Channels: 50
Cluster Domains->Account Storage->Foldering Method: Hashed 2 Levels
Cluster Domains->Account Storage->Generate Index: Yes
Backend Servers: Queue Processing->Submit Messages: Remotely (all SMTP submitted to Frontend queues)
Frontend Servers: Queue Processing->Submit Messages: Locally for Others (all SMTP delivered from Frontend queues)

CommuniGate Pro startup options:
--DefaultStackSize 131072 --useNonBlockingSockets --closeStuckSockets --CreateTempFilesDirectly 10
--ClusterBackend  # Backends
--ClusterFrontend # Frontends

Networking:
Cisco 3750 Switch for server connectivity
Cisco 6506 Switch with Sup 720 for BlueArc Titan connectivity

This benchmark was performed at the BlueArc lab in San Jose, California.

For questions about this result, please contact the tester.
For other inquiries, please contact webmaster@spec.org
Copyright © 1999-2001 Standard Performance Evaluation Corporation

First published at SPEC.org on 29-Jul-2005

Benchmark run on Thu Jul 07 03:29:09 PDT 2005 by SPECmail2001 v1.01
Report generated on Mon Aug 15 17:30:30 EDT 2005 by SPECmail2001 v1.05 HTML Formatter