SPEC Seal of Reviewal SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation
Intrastore 2001 - Redhat Linux 7.2 SPECmail2001 msgs/min = 2,500
SPEC license # 2018 Tested by:
Syntegra		 Test date:
Apr-2002		 Hardware Avail:
Aug-2001		 Software Avail:
Feb-2002

2,500 SPECmail2001 messages per minute is equivalent to 500,000 SPECmail2001_users.

Detail Summary | General Notes
System configurations: SMTP Server + POP Server | Load Generator | Load Balancer + LDAP Server | Mail Sink + Benchmark Manager + Load Generator | Configuration diagram
Detailed results: Detailed Results 80% load | Detailed Results 100% load | Detailed Results 120% load


Summary Results
Function Response
time limit
(seconds)		 Required
Percentage
Compliant		 Percentage Compliant
80% 100% 120%
SMTP Connect 5 >95% 99.98% 99.97% 99.96%
SMTP Data 5 >95% 100.00% 100.00% 100.00%
POP Connect 5 >95% 99.98% 99.98% 99.96%
POP Status 5 >95% 100.00% 100.00% 21.86%
POP Retrieve 5 >95% 100.00% 100.00% 19.91%
POP Delete 5 >95% 100.00% 100.00% 22.46%
Delivery Time 60 >95% 99.06% 99.15% 97.22%
Error Rate NA <1% 0.00% 0.00% 0.56%

SMTP Server + POP Server (3 systems)
Software
Software: Intrastore 2001 Operating System: Redhat Linux 7.2 (kernel 2.4.18)
Availability: Mar-2001 File System: EXT3
Hardware
Vendor: Compaq CPU: Pentium III
Model Name: DL380 CPU MHz: 1000
Availability: Jun-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 2 x 18GB SCSI Primary Cache: 16KBI + 16KBD on chip
Memory (MB): 1024 Secondary Cache: 256KB
Network: Compaq NC3163 10/100 (2) Other Cache: N/A
# of Systems: 3 Other: Disks in RAID 1 config
Notes / Tuning Information 
Second network card has dedicated route to NetApp

RAID-1 provided by integrated Compaq SmartArray controller

MSL is 30 seconds
TIMEWAIT is 60 seconds

SMTPserver options: -Ca -rt 900 -Cr 200 -CD -na -I SMTP-out -D syntegra.com -Sc 1000 -S
imsd options: -Vd -L /var/adm/imsd.log -tpool 50 -tmax 125

Load Generator (3 systems)
Software
JVM: Java HotSpot(TM) Client VM (build 1.4.0-b92, mixed mode) (no JIT) Operating System: Redhat Linux 7.2 (kernel 2.4.18)
Availability: Feb-2002 File System: EXT3
Hardware
Vendor: Compaq CPU: Pentium III
Model Name: DL380 CPU MHz: 1000
Availability: Jul-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 2 x 18GB SCSI Primary Cache: 16KBI + 16KBD on chip
Memory (MB): 1024 Secondary Cache: 256KB
Network: Compaq NC3163 10/100 (2) Other Cache: N/A
# of Systems: 3 Other: Disks in RAID 1 config
Notes / Tuning Information 

   		
  

 













Load Balancer + LDAP Server (1 system)




 

  
Software

  

 Software:           
Aphelion 2001
Operating System:
Redhat Linux 7.2 (kernel 2.4.18)
  

  

Availability:
Mar-2001
File System:
EXT3
  

 





 

  
Hardware

  

Vendor:
Gateway
CPU:
Pentium III
  

  

Model Name:
6400
CPU MHz:
933
  

  

Availability:
Aug-2001
CPUs Enabled:
1 core, 1 chip, 1 core/chip
  

  

Disk Subsystem:
1 x 9GB SCSI
Primary Cache:
16KBI + 16KBD on chip
  

  

Memory (MB):
640
Secondary Cache:
256KB
  

  

Network:
Intel 10/100
Other Cache:
N/A
  

  

# of Systems:
1
Other:
N/A
  

 





 

  

Notes / Tuning Information
  

  

   

Load balancing was provided by the Linux Virtual Server Project found at www.linuxvirtualserver.org
SMTP and POP connections were load-balanced using a least-connection scheduling algorithm
Direct routing was used to route the load balanced connections between servers
The kernel was patched with ipvs-1.0.1 patch


   		
  

 













Mail Sink + Benchmark Manager + Load Generator (2 systems)




 

  
Software

  

JVM:
Java HotSpot(TM) Client VM (build 1.4.0-b92, mixed mode) (no JIT)
Operating System:
Redhat Linux 7.2 (kernel 2.4.18)
  

  

Availability:
Feb-2002
File System:
EXT3
  

 





 

  
Hardware

  

Vendor:
Dell
CPU:
Pentium III
  

  

Model Name:
Poweredge 6300
CPU MHz:
500
  

  

Availability:
Aug-1999
CPUs Enabled:
4 cores, 4 chips, 1 core/chip
  

  

Disk Subsystem:
1 x 9GB SCSI
Primary Cache:
16KBI + 16KBD on chip
  

  

Memory (MB):
1024
Secondary Cache:
512Kb
  

  

Network:
3Com 905c 100Mb
Other Cache:
N/A
  

  

# of Systems:
2
Other:
N/A
  

 





 

  

Notes / Tuning Information
  

  

   


   		
  

 













Detailed Results -- 80% Load		




Load
User Count
Message Rate
(msg/min)		




Attempted
400,000
2,000




Actual
400,600
2,003




Function
Attempts
# Pass
QoS		
% Pass
QoS		




SMTP Connect
228,079
228,040
99.98%




SMTP Hello
228,075
228,049
99.99%




SMTP Mail From
228,073
228,073
100.00%




SMTP Rcpt To
454,742
454,742
100.00%




SMTP Data
228,081
228,078
100.00%




SMTP Quit
225,790
225,790
100.00%




POP Connect
240,559
240,510
99.98%




POP User ID
240,562
240,524
99.98%




POP Password
240,562
240,562
100.00%




POP Status
240,562
240,562
100.00%




POP Retrieve
240,053
240,052
100.00%




POP Delete
239,369
239,369
100.00%




POP Quit
239,844
239,844
100.00%




Delivery Time
2,237
2,216
99.06%




SMTP Data Response Time
228,081
225,785
98.99%




POP Retrieve Response Time
240,053
239,724
99.86%




Remote Message Delivery
215,930
213,754
98.99%





Counter		

Value		




SMTP Connect Error
0




SMTP Protocol Error
0




SMTP Disconnect
2,293




SMTP Session
225,790




SMTP To Local
238,811




SMTP To Remote
215,930




SINK Connect Error
0




POP Connect Error
0




POP Protocol Error
0




POP Disconnect
687




POP Session
239,844




Delivery Time Connect Error
0




Function
Minimum Time
(millisec)		
Maximum Time
(millisec)		
Average Time
(millisec)		




SMTP Connect
0
20,997
40.16




SMTP Hello
0
20,996
52.41




SMTP Mail From
0
1,463
26.76




SMTP Rcpt To
0
3,213
26.95




SMTP Data
0
30,160
162.00




SMTP Quit
0
1,530
27.16




POP Connect
0
12,018
51.89




POP User ID
0
21,093
83.13




POP Password
2
1,621
125.62




POP Status
0
3,211
50.47




POP Retrieve
4
30,171
120.12




POP Delete
0
3,146
51.01




POP Quit
0
3,414
50.25




Function
Minimum Size
(KB)		
Maximum Size
(KB)		
Average Size
(KB)		




SMTP Data (KB up)
1
2,674
24.70




POP Retrieve (KB down)
1
2,675
24.53











Detailed Results -- 100% Load		




Load
User Count
Message Rate
(msg/min)		




Attempted
500,000
2,500




Actual
501,200
2,506




Function
Attempts
# Pass
QoS		
% Pass
QoS		




SMTP Connect
285,369
285,293
99.97%




SMTP Hello
285,364
285,299
99.98%




SMTP Mail From
285,365
285,363
100.00%




SMTP Rcpt To
570,840
570,840
100.00%




SMTP Data
285,347
285,346
100.00%




SMTP Quit
282,457
282,457
100.00%




POP Connect
301,078
301,006
99.98%




POP User ID
301,078
301,011
99.98%




POP Password
301,087
301,087
100.00%




POP Status
301,087
301,087
100.00%




POP Retrieve
301,723
301,721
100.00%




POP Delete
300,863
300,863
100.00%




POP Quit
300,171
300,171
100.00%




Delivery Time
2,930
2,905
99.15%




SMTP Data Response Time
285,347
282,457
98.99%




POP Retrieve Response Time
301,723
301,299
99.86%




Remote Message Delivery
268,418
265,694
98.99%





Counter		

Value		




SMTP Connect Error
0




SMTP Protocol Error
0




SMTP Disconnect
2,888




SMTP Session
282,457




SMTP To Local
302,419




SMTP To Remote
268,418




SINK Connect Error
0




POP Connect Error
0




POP Protocol Error
0




POP Disconnect
858




POP Session
300,171




Delivery Time Connect Error
0




Function
Minimum Time
(millisec)		
Maximum Time
(millisec)		
Average Time
(millisec)		




SMTP Connect
0
20,999
47.54




SMTP Hello
0
20,998
56.79




SMTP Mail From
0
12,061
27.19




SMTP Rcpt To
0
1,538
26.86




SMTP Data
0
30,937
183.05




SMTP Quit
0
1,471
27.57




POP Connect
0
21,031
59.19




POP User ID
0
21,101
87.16




POP Password
3
2,620
156.63




POP Status
0
2,990
51.17




POP Retrieve
5
30,185
168.69




POP Delete
0
3,214
52.93




POP Quit
0
1,680
50.99




Function
Minimum Size
(KB)		
Maximum Size
(KB)		
Average Size
(KB)		




SMTP Data (KB up)
1
2,674
24.63




POP Retrieve (KB down)
1
2,675
24.72











Detailed Results -- 120% Load		




Load
User Count
Message Rate
(msg/min)		




Attempted
600,000
3,000




Actual
590,600
2,953




Function
Attempts
# Pass
QoS		
% Pass
QoS		




SMTP Connect
342,894
342,744
99.96%




SMTP Hello
342,897
342,775
99.96%




SMTP Mail From
342,898
342,897
100.00%




SMTP Rcpt To
684,811
684,811
100.00%




SMTP Data
342,910
342,904
100.00%




SMTP Quit
339,524
339,524
100.00%




POP Connect
359,806
359,648
99.96%




POP User ID
351,932
59,258
16.84%




POP Password
349,616
61,896
17.70%




POP Status
347,813
76,036
21.86%




POP Retrieve
334,193
66,522
19.91%




POP Delete
330,742
74,293
22.46%




POP Quit
338,734
70,989
20.96%




Delivery Time
3,207
3,118
97.22%




SMTP Data Response Time
342,910
339,521
99.01%




POP Retrieve Response Time
334,193
74,081
22.17%




Remote Message Delivery
322,427
319,540
99.10%





Counter		

Value		




SMTP Connect Error
0




SMTP Protocol Error
0




SMTP Disconnect
3,385




SMTP Session
339,524




SMTP To Local
362,384




SMTP To Remote
322,427




SINK Connect Error
0




POP Connect Error
3,831




POP Protocol Error
0




POP Disconnect
883




POP Session
342,626




Delivery Time Connect Error
43




Function
Minimum Time
(millisec)		
Maximum Time
(millisec)		
Average Time
(millisec)		




SMTP Connect
0
21,037
55.82




SMTP Hello
0
21,389
62.25




SMTP Mail From
0
12,000
27.99




SMTP Rcpt To
0
3,359
27.88




SMTP Data
0
30,195
211.82




SMTP Quit
0
1,799
28.65




POP Connect
0
20,997
71.66




POP User ID
0
63,596
26,032.69




POP Password
50
61,031
15,948.48




POP Status
0
38,082
14,316.53




POP Retrieve
33
42,025
17,213.04




POP Delete
0
47,008
15,788.81




POP Quit
0
41,761
15,820.35




Function
Minimum Size
(KB)		
Maximum Size
(KB)		
Average Size
(KB)		




SMTP Data (KB up)
1
2,674
24.34




POP Retrieve (KB down)
1
2,675
24.58












General Notes / Tuning Information





A Network Appliance F820 with 9 36GB drives in a single raid group
was used to store the mailboxes via NFS.
It was mounted with the NFS options: vers=3,tcp,noatime,wsize=32768,rsize=32768

Aphelion 2001 was used for the LDAP server.

Linux tuning paremeters:
echo 4096 >> /proc/sys/net/core/netdev_max_backlog
echo 2000000 >> /proc/sys/net/ipv4/tcp_max_tw_buckets
echo 0 >> /proc/sys/net/ipv4/tcp_window_scaling
echo 0 >> /proc/sys/net/ipv4/tcp_timestamps
echo 0 >> /proc/sys/net/ipv4/tcp_sack
echo 0 >> /proc/sys/net/ipv4/ip_forward

echo 1048576 >> /proc/sys/net/core/wmem_default
echo 1048576 >> /proc/sys/net/core/wmem_max
echo 1048576 >> /proc/sys/net/core/rmem_default
echo 1048576 >> /proc/sys/net/core/rmem_max

A 3Com 3300 switch (24 port 10/100Mb) was used for LAN connectivity.

Description of imsd options used:
-Vd  disable DNS lookup for clients
-L   name of an alternate debug log
-tpool minimum number of available processing threads (default = 16)
-tmax  maximum number of processing threads allowed (default = 16384)

Description of SMTPserver options used:
-Ca  host:service name of imsd administrative service
-rt  read timeout in seconds
-Cr  recipient number threshold causing queueing at low priority
-CD  enable automatic creation of mailbox directories
-na  Do not send AUTH
-I   name of the SMTP input queue (default is SMTP-in)
-D   limit delivery/relaying to allowed deliver/relay domains
-Sc  per client session threshold
-S   total session threshold
-ar  avoid reverse host address lookup









For questions about this result, please contact the tester.

For other inquiries, please contact
webmaster@spec.org

Copyright © 1999-2001 Standard Performance Evaluation Corporation



First published at SPEC.org on 22-May-2002


Benchmark run on Wed Apr 17 18:12:47 CDT 2002 by SPECmail2001 v1.01

Report generated on Mon Apr 25 17:25:12 EDT 2005 by SPECmail2001 v1.05 HTML Formatter