SPEC Seal of Reviewal SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation
MIO Mail Server 3.30 SPECmail2001 msgs/min = 1,000
SPEC license # 000071 Tested by:
Mobile Internet (Mobico)
Test date:
Jul-2002
Hardware Avail:
Sep-2001
Software Avail:
Jun-2002

1,000 SPECmail2001 messages per minute is equivalent to 200,000 SPECmail2001_users.

Detail Summary | General Notes
System configurations: SMTP Server,POP3 Server,Message Store | Benchmark Manager, Mail Sink | Load Generator I, Load Generator II, Load Generator III | Configuration diagram
Detailed results: Detailed Results 80% load | Detailed Results 100% load | Detailed Results 120% load


Summary Results
Function Response
time limit
(seconds)
Required
Percentage
Compliant
Percentage Compliant
80% 100% 120%
SMTP Connect 5 >95% 100.00% 100.00% 70.24%
SMTP Data 5 >95% 98.80% 96.91% 24.99%
POP Connect 5 >95% 100.00% 100.00% 44.27%
POP Status 5 >95% 100.00% 100.00% 100.00%
POP Retrieve 5 >95% 100.00% 100.00% 99.79%
POP Delete 5 >95% 100.00% 100.00% 100.00%
Delivery Time 60 >95% 99.37% 99.74% 65.95%
Error Rate NA <1% 0.00% 0.00% 20.11%

SMTP Server,POP3 Server,Message Store (1 system)
Software
Mio Mail Server: 3.30 Operating System: Red Hat Linux 7.2 (kernel 2.4.7-10)
Availability: Jun-2002 File System: ext2
Hardware
Vendor: Intel CPU: Intel PIII
Model Name: STL2 Server Board+RAID Board SRC231UL CPU MHz: 933
Availability: Jan-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 3 x 18GB SCSI Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 1024 Secondary Cache: 256KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 1 Other: RAID-0
Notes / Tuning Information
Tuning (/etc/sysctl.conf):
net.ipv4.tcp_fin_timeout=60
fs.file-max=32678

Benchmark Manager, Mail Sink (2 systems)
Software
JVM: Sun JDK v1.2.1 (native threads,sunwjit) Operating System: SunOS 5.7 i86pc
Availability: Sep-2001 File System: UFS
Hardware
Vendor: CPU: Celeron
Model Name: CPU MHz: 700
Availability: Sep-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 40GB Primary Cache: 16KbI + 16KbD
Memory (MB): 256 Secondary Cache: 256Kb Unified On-Chip
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 2 Other: N/A
Notes / Tuning Information

   

Load Generator I, Load Generator II, Load Generator III (3 systems)
Software
JVM: Sun Java 2 SDK SE v1.3.1_01 (symc) Operating System: Microsoft Windows 2000
Availability: Sep-2001 File System: NTFS
Hardware
Vendor: CPU: Celeron
Model Name: CPU MHz: 700
Availability: Sep-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 40GB Primary Cache: 16KbI + 16KbD
Memory (MB): 256 Secondary Cache: 256Kb Unified On-Chip
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 3 Other: N/A
Notes / Tuning Information
Set the following registry parameter:
HKEY_LOCAL_MACHINE/SYSTEM/CurrentControlSet/Services/Tcpip/Parameters
MaxUserPort = 0xfffe


Detailed Results -- 80% Load
Load User Count Message Rate
(msg/min)
Attempted 160,000 800
Actual 159,800 799
Function Attempts # Pass
QoS
% Pass
QoS
SMTP Connect 91,012 91,012 100.00%
SMTP Hello 91,012 91,012 100.00%
SMTP Mail From 91,013 91,013 100.00%
SMTP Rcpt To 181,637 181,637 100.00%
SMTP Data 91,013 89,919 98.80%
SMTP Quit 90,124 90,124 100.00%
POP Connect 96,044 96,044 100.00%
POP User ID 96,044 96,044 100.00%
POP Password 96,049 96,049 100.00%
POP Status 96,049 96,049 100.00%
POP Retrieve 95,160 95,160 100.00%
POP Delete 94,894 94,894 100.00%
POP Quit 95,776 95,776 100.00%
Delivery Time 949 943 99.37%
SMTP Data Response Time 91,013 89,604 98.45%
POP Retrieve Response Time 95,160 95,021 99.85%
Remote Message Delivery 85,521 85,650 100.15%

Counter

Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 889
SMTP Session 90,124
SMTP To Local 96,116
SMTP To Remote 85,521
SINK Connect Error 0
POP Connect Error 0
POP Protocol Error 0
POP Disconnect 266
POP Session 95,776
Delivery Time Connect Error 0
Function Minimum Time
(millisec)
Maximum Time
(millisec)
Average Time
(millisec)
SMTP Connect 0 250 3.82
SMTP Hello 0 300 7.35
SMTP Mail From 0 240 6.13
SMTP Rcpt To 0 241 6.38
SMTP Data 0 12,718 441.93
SMTP Quit 0 281 5.13
POP Connect 0 361 11.91
POP User ID 0 330 20.06
POP Password 0 1,632 248.00
POP Status 0 300 4.13
POP Retrieve 0 1,191 70.64
POP Delete 0 391 5.73
POP Quit 0 3,605 56.09
Function Minimum Size
(KB)
Maximum Size
(KB)
Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.15
POP Retrieve (KB down) 0 2,675 24.21


Detailed Results -- 100% Load
Load User Count Message Rate
(msg/min)
Attempted 200,000 1,000
Actual 199,200 996
Function Attempts # Pass
QoS
% Pass
QoS
SMTP Connect 113,054 113,054 100.00%
SMTP Hello 113,053 113,053 100.00%
SMTP Mail From 113,053 113,053 100.00%
SMTP Rcpt To 226,831 226,831 100.00%
SMTP Data 113,059 109,562 96.91%
SMTP Quit 111,918 111,918 100.00%
POP Connect 120,028 120,028 100.00%
POP User ID 120,027 120,027 100.00%
POP Password 120,038 120,038 100.00%
POP Status 120,038 120,038 100.00%
POP Retrieve 120,174 120,174 100.00%
POP Delete 119,860 119,860 100.00%
POP Quit 119,756 119,756 100.00%
Delivery Time 1,149 1,146 99.74%
SMTP Data Response Time 113,059 109,460 96.82%
POP Retrieve Response Time 120,174 120,003 99.86%
Remote Message Delivery 108,280 108,235 99.96%

Counter

Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 1,141
SMTP Session 111,918
SMTP To Local 118,549
SMTP To Remote 108,280
SINK Connect Error 0
POP Connect Error 0
POP Protocol Error 0
POP Disconnect 314
POP Session 119,756
Delivery Time Connect Error 0
Function Minimum Time
(millisec)
Maximum Time
(millisec)
Average Time
(millisec)
SMTP Connect 0 2,984 4.85
SMTP Hello 0 1,112 8.32
SMTP Mail From 0 340 6.49
SMTP Rcpt To 0 501 6.82
SMTP Data 0 26,172 811.72
SMTP Quit 0 471 5.55
POP Connect 0 631 14.26
POP User ID 0 511 22.74
POP Password 0 2,953 501.17
POP Status 0 921 4.72
POP Retrieve 0 2,003 161.84
POP Delete 0 1,061 6.53
POP Quit 0 4,719 90.07
Function Minimum Size
(KB)
Maximum Size
(KB)
Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.86
POP Retrieve (KB down) 0 2,675 25.13


Detailed Results -- 120% Load
Load User Count Message Rate
(msg/min)
Attempted 240,000 1,200
Actual 192,400 962
Function Attempts # Pass
QoS
% Pass
QoS
SMTP Connect 116,625 81,919 70.24%
SMTP Hello 116,625 94,390 80.93%
SMTP Mail From 116,625 116,625 100.00%
SMTP Rcpt To 234,891 234,891 100.00%
SMTP Data 113,476 28,352 24.99%
SMTP Quit 112,310 112,310 100.00%
POP Connect 111,480 49,349 44.27%
POP User ID 111,479 81,568 73.17%
POP Password 111,495 107,016 95.98%
POP Status 111,494 111,493 100.00%
POP Retrieve 115,327 115,085 99.79%
POP Delete 115,005 115,005 100.00%
POP Quit 110,947 98,197 88.51%
Delivery Time 1,395 920 65.95%
SMTP Data Response Time 113,476 40,999 36.13%
POP Retrieve Response Time 115,327 114,354 99.16%
Remote Message Delivery 110,171 35,673 32.38%

Counter

Value
SMTP Connect Error 24,019
SMTP Protocol Error 0
SMTP Disconnect 1,166
SMTP Session 136,329
SMTP To Local 124,720
SMTP To Remote 110,171
SINK Connect Error 0
POP Connect Error 32,550
POP Protocol Error 0
POP Disconnect 321
POP Session 143,497
Delivery Time Connect Error 511
Function Minimum Time
(millisec)
Maximum Time
(millisec)
Average Time
(millisec)
SMTP Connect 0 67,188 3,652.57
SMTP Hello 0 58,219 2,382.73
SMTP Mail From 0 3,785 26.60
SMTP Rcpt To 0 3,946 29.22
SMTP Data 0 61,279 12,341.57
SMTP Quit 0 4,146 30.24
POP Connect 841 64,502 7,909.64
POP User ID 200 57,172 5,571.93
POP Password 0 21,531 1,948.68
POP Status 0 17,775 16.40
POP Retrieve 0 18,286 550.01
POP Delete 0 4,366 23.18
POP Quit 0 59,985 1,657.24
Function Minimum Size
(KB)
Maximum Size
(KB)
Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.86
POP Retrieve (KB down) 0 2,675 25.28

General Notes / Tuning Information
-Network connectivity
ATI FS708 8-port ethernet switch 1/100Mb
-Install software package
  pkgadd -d MIOserv.pkg
and start standart configuration creation script
cd mio/bin
./makedefconf.sh
./admcmd -def -s servman setprop autostart mqueue,smtp,pop3
./admcmd -def -s general setprop msg_daemon_mode 1
./admcmd -def -s general setprop max_mbox_size_unit 1
./admcmd -def -s general setprop max_mbox_size 104857600
./admcmd -def -s general setprop max_num_recps 100
./admcmd -def -s pop3 setprop minprocs  2
./admcmd -def -s pop3 setprop threads   200
./admcmd -def -s pop3 setprop incpercent 100
./admcmd -def -s pop3 setprop log_level 2
./admcmd -def -s smtp setprop minprocs  2
./admcmd -def -s smtp setprop threads   200
./admcmd -def -s smtp setprop incpercent 100
./admcmd -def -s smtp setprop log_level 2
./admcmd -def -s smtp setprop direct_delivery 1
./admcmd -def -s mqueue setprop max_local_channels    50
./admcmd -def -s mqueue setprop max_remote_channels   50
./admcmd -def -s mqueue setprop jobs_per_leaf   50
./admcmd -def -s mqueue setprop log_level 2

The SUT requires an APC Smart UPS 1400.


For questions about this result, please contact the tester.
For other inquiries, please contact webmaster@spec.org
Copyright © 1999-2001 Standard Performance Evaluation Corporation

First published at SPEC.org on 31-Jul-2002

Benchmark run on Tue Jul 16 00:58:22 GMT-03:00 2002 by SPECmail2001 v1.00
Report generated on Mon Apr 25 17:24:38 EDT 2005 by SPECmail2001 v1.05 HTML Formatter