SPEC Seal of Reviewal SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation
IBM: eServer xSeries 200 - Red Hat Linux 7.1 SPECmail2001 msgs/min = 100
SPEC license # 11 Tested by:
IBM		 Test date:
Oct-2001		 Hardware Avail:
Mar-2001		 Software Avail:
Apr-2001

100 SPECmail2001 messages per minute is equivalent to 20,000 SPECmail2001_users.

Detail Summary | General Notes
System configurations: SMTP Server | Benchmark Manager | Load Generator | SMTP Sink | Configuration diagram
Detailed results: Detailed Results 80% load | Detailed Results 100% load | Detailed Results 120% load


Summary Results
Function Response
time limit
(seconds)		 Required
Percentage
Compliant		 Percentage Compliant
80% 100% 120%
SMTP Connect 5 >95% 99.91% 99.88% 99.83%
SMTP Data 5 >95% 96.98% 98.31% 98.56%
POP Connect 5 >95% 100.00% 99.95% 99.97%
POP Status 5 >95% 100.00% 100.00% 100.00%
POP Retrieve 5 >95% 99.94% 99.97% 99.93%
POP Delete 5 >95% 100.00% 100.00% 100.00%
Delivery Time 60 >95% 97.00% 99.11% 100.00%
Error Rate NA <1% 1.11% 0.64% 0.56%

SMTP Server (1 system)
Software
SMTP Software: Lotus Domino Mail Server Release 5.04 Operating System: Red Hat Linux 7.1 (kernel 2.4.2-2)
Availability: Jun-2000 File System: ext2
Hardware
Vendor: IBM CPU: Intel Pentium III
Model Name: xSeries x200 CPU MHz: 1000
Availability: Mar-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 14 x 18GB 15K RPM SCSI + 1 x 18GB 10K RPM SCSI Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 1536 Secondary Cache: 256KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 1 Other: ServeRAID 4H RAID Adapter: RAID0 + OS Drive
Notes / Tuning Information 
Hostname: Sut

Tuning Information:
ulimit -n 8192, default = 1024
/proc/sys/fs/file-max = 65536, default =
/proc/sys/net/ipv4/ip_local_port_range = 16384 65536, default =
File system mounted synchronously

Benchmark Manager (1 system)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_008 (symc) Operating System: Microsoft Windows 2000 Advanced Server 5.00.2195
Availability: Apr-2001 File System: NTFS
Hardware
Vendor: IBM CPU: Pentium III
Model Name: eServer xSeries 330 CPU MHz: 933
Availability: Mar-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 9GB SCSI Primary Cache: 16KbI + 16KbD
Memory (MB): 256 Secondary Cache: 256Kb
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information 
HostName: Client15

Load Generator (2 systems)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_008 (symc) Operating System: Microsoft Windows 2000 Advanced Server 5.00.2195
Availability: Apr-2001 File System: NTFS
Hardware
Vendor: IBM CPU: Pentium III
Model Name: xSeries x330 CPU MHz: 933
Availability: Mar-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 9GB SCSI Primary Cache: 16KbI + 16KbD
Memory (MB): 256 Secondary Cache: 256Kb
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 2 Other: N/A
Notes / Tuning Information 
Hostnames: Client14, Client10

SMTP Sink (1 system)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_008 (symc) Operating System: Microsoft Windows 2000 Advanced Server 5.00.2195
Availability: Apr-2001 File System: NTFS
Hardware
Vendor: IBM CPU: Pentium III
Model Name: xSeries x330 CPU MHz: 933
Availability: Mar-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 9GB SCSI Primary Cache: 16KbI + 16KbD
Memory (MB): 256 Secondary Cache: 256Kb
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information 
Hostname: Client13


Detailed Results -- 80% Load
Load User Count Message Rate
(msg/min)
Attempted 16,000 80
Actual 15,800 79
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 9,027 9,019 99.91%
SMTP Hello 9,027 9,020 99.92%
SMTP Mail From 9,027 9,027 100.00%
SMTP Rcpt To 18,697 18,697 100.00%
SMTP Data 8,994 8,722 96.98%
SMTP Quit 8,907 8,907 100.00%
POP Connect 9,614 9,614 100.00%
POP User ID 9,614 9,614 100.00%
POP Password 9,440 9,173 97.17%
POP Status 9,440 9,440 100.00%
POP Retrieve 9,424 9,418 99.94%
POP Delete 9,394 9,394 100.00%
POP Quit 9,423 9,423 100.00%
Delivery Time 100 97 97.00%
SMTP Data Response Time 8,994 8,652 96.20%
POP Retrieve Response Time 9,424 9,411 99.86%
Remote Message Delivery 8,775 8,681 98.93%

Counter
Value
SMTP Connect Error 33
SMTP Protocol Error 0
SMTP Disconnect 87
SMTP Session 8,940
SMTP To Local 9,922
SMTP To Remote 8,775
SINK Connect Error 0
POP Connect Error 175
POP Protocol Error 116
POP Disconnect 31
POP Session 9,598
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 9,390 26.88
SMTP Hello 0 9,406 35.17
SMTP Mail From 0 250 9.81
SMTP Rcpt To 0 547 11.20
SMTP Data 0 66,141 1,072.89
SMTP Quit 0 1,797 13.95
POP Connect 0 1,672 16.09
POP User ID 0 1,672 27.11
POP Password 31 59,562 1,117.99
POP Status 0 2,094 14.33
POP Retrieve 0 10,047 68.63
POP Delete 0 2,735 13.23
POP Quit 0 1,656 22.50
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 25.42
POP Retrieve (KB down) 1 2,676 25.53


Detailed Results -- 100% Load
Load User Count Message Rate
(msg/min)
Attempted 20,000 100
Actual 19,800 99
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 11,295 11,281 99.88%
SMTP Hello 11,295 11,286 99.92%
SMTP Mail From 11,295 11,295 100.00%
SMTP Rcpt To 22,151 22,151 100.00%
SMTP Data 11,297 11,106 98.31%
SMTP Quit 11,187 11,187 100.00%
POP Connect 11,998 11,992 99.95%
POP User ID 11,998 11,995 99.97%
POP Password 11,849 11,664 98.44%
POP Status 11,849 11,849 100.00%
POP Retrieve 11,902 11,899 99.97%
POP Delete 11,874 11,874 100.00%
POP Quit 11,817 11,817 100.00%
Delivery Time 112 111 99.11%
SMTP Data Response Time 11,297 11,028 97.62%
POP Retrieve Response Time 11,902 11,884 99.85%
Remote Message Delivery 10,487 10,397 99.14%

Counter
Value
SMTP Connect Error 1
SMTP Protocol Error 0
SMTP Disconnect 110
SMTP Session 11,188
SMTP To Local 11,664
SMTP To Remote 10,487
SINK Connect Error 0
POP Connect Error 148
POP Protocol Error 145
POP Disconnect 28
POP Session 11,965
Delivery Time Connect Error 1
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 10,438 28.38
SMTP Hello 0 10,453 35.51
SMTP Mail From 0 422 10.12
SMTP Rcpt To 0 297 11.81
SMTP Data 0 58,079 530.63
SMTP Quit 0 1,328 17.23
POP Connect 0 10,297 26.54
POP User ID 0 10,312 32.06
POP Password 31 57,547 701.18
POP Status 0 2,953 15.01
POP Retrieve 0 5,782 65.69
POP Delete 0 2,422 13.89
POP Quit 0 1,781 21.60
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.35
POP Retrieve (KB down) 1 2,676 25.82


Detailed Results -- 120% Load
Load User Count Message Rate
(msg/min)
Attempted 24,000 120
Actual 23,800 119
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 13,553 13,530 99.83%
SMTP Hello 13,553 13,544 99.93%
SMTP Mail From 13,553 13,553 100.00%
SMTP Rcpt To 26,591 26,591 100.00%
SMTP Data 13,554 13,359 98.56%
SMTP Quit 13,425 13,425 100.00%
POP Connect 14,492 14,488 99.97%
POP User ID 14,492 14,491 99.99%
POP Password 14,333 14,148 98.71%
POP Status 14,333 14,333 100.00%
POP Retrieve 14,784 14,774 99.93%
POP Delete 14,732 14,732 100.00%
POP Quit 14,285 14,285 100.00%
Delivery Time 134 134 100.00%
SMTP Data Response Time 13,554 13,259 97.82%
POP Retrieve Response Time 14,784 14,754 99.80%
Remote Message Delivery 12,655 12,543 99.11%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 129
SMTP Session 13,425
SMTP To Local 13,936
SMTP To Remote 12,655
SINK Connect Error 0
POP Connect Error 158
POP Protocol Error 156
POP Disconnect 52
POP Session 14,443
Delivery Time Connect Error 1
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 10,765 36.32
SMTP Hello 0 10,781 37.29
SMTP Mail From 0 359 10.62
SMTP Rcpt To 0 313 11.99
SMTP Data 0 55,187 535.05
SMTP Quit 0 1,516 18.24
POP Connect 0 9,672 29.38
POP User ID 0 9,172 36.44
POP Password 16 53,109 653.61
POP Status 0 2,406 23.39
POP Retrieve 0 9,234 80.76
POP Delete 0 1,922 15.86
POP Quit 0 2,265 23.96
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 21.66
POP Retrieve (KB down) 1 2,676 26.56

General Notes / Tuning Information

For questions about this result, please contact the tester.
For other inquiries, please contact webmaster@spec.org
Copyright © 1999-2001 Standard Performance Evaluation Corporation

First published at SPEC.org on 25-Oct-2001

Benchmark run on Wed Oct 24 11:54:35 EDT 2001 by SPECmail2001 v1.01
Report generated on Mon Apr 25 17:24:12 EDT 2005 by SPECmail2001 v1.05 HTML Formatter