SPEC Seal of Reviewal SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation
Novell IMS 3.1 SPECmail2001 msgs/min = 1,050
SPEC license # 31 Tested by:
Novell, Inc		 Test date:
Mar-2002		 Hardware Avail:
Aug-2001		 Software Avail:
May-2002

1,050 SPECmail2001 messages per minute is equivalent to 210,000 SPECmail2001_users.

Detail Summary | General Notes
System configurations: NIMS Server | Mail Sinks | Controller | Load Generator | Configuration diagram
Detailed results: Detailed Results 80% load | Detailed Results 100% load | Detailed Results 120% load


Summary Results
Function Response
time limit
(seconds)		 Required
Percentage
Compliant		 Percentage Compliant
80% 100% 120%
SMTP Connect 5 >95% 100.00% 100.00% 100.00%
SMTP Data 5 >95% 100.00% 100.00% 96.84%
POP Connect 5 >95% 100.00% 100.00% 100.00%
POP Status 5 >95% 100.00% 100.00% 100.00%
POP Retrieve 5 >95% 100.00% 100.00% 100.00%
POP Delete 5 >95% 100.00% 100.00% 100.00%
Delivery Time 60 >95% 98.85% 99.10% 67.31%
Error Rate NA <1% 0.00% 0.00% 0.15%

NIMS Server (1 system)
Software
Version: NIMS 3.1.0 Operating System: Netware 5.1 SP3
Availability: May-2002 File System: Netware Traditional
Hardware
Vendor: IBM CPU: Pentium III Xeon
Model Name: EServer X Series 342 CPU MHz: 1266
Availability: Aug-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: Internal: 6 x 36.4GB Ultra 160 SCSI (10k RPM) RAID 0 External: 14 X 36.4GB (10k RPM) SCSI Array (EXP 300) RAID 0 Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 4096 Secondary Cache: 512KB
Network: Intel Pro 1000XF Other Cache: N/A
# of Systems: 1 Other: Internal Controler: IBM SERVRAID-4Lx (32MB Cache) External Controller: IBM SERVRAID-4Mx (64MB Cache) connected to EXP 300 Array
Notes / Tuning Information 
- NetWare Configuration:
  - NetWare 5.1 Support Pack 3
  - Volumes
    - MAIL
      - External Array
      - 64 KB Block Size
      - No SubAllocation
    - SPOOL
      - Internal Array
      - 64 KB Block Size
      - No SubAllocation
  - Settings
    - Maximum Pending TCP Connection Requests = 4096
    - TCP Defend Land Attacks = off
    - Minimum Packet Receive Buffers = 20000
    - Maximum Packet Receive Buffers = 200000
    - Dirty Directory Cache Delay Time = 10
    - Dirty Disk Cache Delay Time = 10
    - Maximum Concurrent Directory Cache Writes = 500
    - Directory Cache Allocation Wait Time = 0.1
    - Maximum Directory Cache Buffers = 20000
    - Minimum Directory Cache Buffers = 20000
    - Maximum Number Of Internal Directory Handles = 1000
    - Maximum Number Of Directory Handles = 1000
    - Enable Hardware Write Back = On
    - Maximum Concurrent Disk Cache Writes = 4000
    - Immediate Purge Of Deleted Files = On
    - Enable File Compression = off
    - Maximum Record Locks Per Connection = 10000
    - Maximum File Locks Per Connection = 10000
    - Maximum Record Locks = 20000
    - Maximum File Locks = 100000
    - TCP IP Maximum Small ECBs = 65534
  - Executed in Autoexec.ncf
    - CE1000.LAN xsumrx=1 xsumtx=1 txindelay=40
    - unload idecd ideata
    - syslogd
    - IMS
- Directory Services:
  - Version 85.23
  - 50.000 users per context
- TCPIP Stack:
  - TCPIP.NLM Version 5.42u July 23, 2001
- NIMS
  - Agents
    - POP
      - Default Settings
    - SMTP
      - Default Settings
    - NMAP
      - Load monitor configuration
        - High Threshold: 97
        - Low Threshold: 95

Mail Sinks (4 systems)
Software
JVM: JavaSoft JRE 1.4.0-rc (Symantec) Operating System: Windows 2000
Availability: Jan-2001 File System: FAT32
Hardware
Vendor: CR&T CPU: Pentium III
Model Name: Generic CPU MHz: 733
Availability: Jan-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 20GB Primary Cache: 16KbI + 16KbD
Memory (MB): 256 Secondary Cache: 256Kb Unified On-Chip
Network: Intel Pro/100 Other Cache: N/A
# of Systems: 4 Other: N/A
Notes / Tuning Information 

   		
  

 













Controller (1 system)




 

  
Software

  

JVM:
JavaSoft JRE 1.4.0-rc (Symantec)
Operating System:
Windows 2000
  

  

Availability:
Jan-2000
File System:
FAT32
  

 





 

  
Hardware

  

Vendor:
CR&T
CPU:
Pentium III
  

  

Model Name:
Generic
CPU MHz:
733
  

  

Availability:
Jan-2001
CPUs Enabled:
1 core, 1 chip, 1 core/chip
  

  

Disk Subsystem:
1 x 20GB
Primary Cache:
16KbI + 16KbD
  

  

Memory (MB):
256
Secondary Cache:
256Kb Unified On-Chip
  

  

Network:
Intel Pro/100
Other Cache:
N/A
  

  

# of Systems:
1
Other:
N/A
  

 





 

  

Notes / Tuning Information
  

  

   


   		
  

 













Load Generator (17 systems)




 

  
Software

  

JVM:
SUN JRE 1.4.1-rc (Symantec)
Operating System:
Windows 2000
  

  

Availability:
Jan-2000
File System:
FAT32
  

 





 

  
Hardware

  

Vendor:
CR&T
CPU:
Pentium III
  

  

Model Name:
Generic
CPU MHz:
733
  

  

Availability:
Jan-2001
CPUs Enabled:
1 core, 1 chip, 1 core/chip
  

  

Disk Subsystem:
1 x 20GB
Primary Cache:
16KbI + 16KbD
  

  

Memory (MB):
256
Secondary Cache:
256Kb Unified On-Chip
  

  

Network:
Intel Pro/100
Other Cache:
N/A
  

  

# of Systems:
17
Other:
N/A
  

 





 

  

Notes / Tuning Information
  

  

   


   		
  

 













Detailed Results -- 80% Load		




Load
User Count
Message Rate
(msg/min)		




Attempted
168,000
840




Actual
168,600
843




Function
Attempts
# Pass
QoS		
% Pass
QoS		




SMTP Connect
96,179
96,179
100.00%




SMTP Hello
96,178
96,178
100.00%




SMTP Mail From
96,178
96,178
100.00%




SMTP Rcpt To
192,249
192,249
100.00%




SMTP Data
96,180
96,180
100.00%




SMTP Quit
95,219
95,219
100.00%




POP Connect
101,103
101,103
100.00%




POP User ID
101,103
101,103
100.00%




POP Password
101,105
101,105
100.00%




POP Status
101,105
101,105
100.00%




POP Retrieve
101,392
101,392
100.00%




POP Delete
101,106
101,106
100.00%




POP Quit
100,832
100,832
100.00%




Delivery Time
956
945
98.85%




SMTP Data Response Time
96,180
95,219
99.00%




POP Retrieve Response Time
101,392
101,237
99.85%




Remote Message Delivery
90,709
89,762
98.96%





Counter		

Value		




SMTP Connect Error
0




SMTP Protocol Error
0




SMTP Disconnect
961




SMTP Session
95,219




SMTP To Local
101,539




SMTP To Remote
90,709




SINK Connect Error
0




POP Connect Error
0




POP Protocol Error
0




POP Disconnect
285




POP Session
100,832




Delivery Time Connect Error
0




Function
Minimum Time
(millisec)		
Maximum Time
(millisec)		
Average Time
(millisec)		




SMTP Connect
0
211
10.43




SMTP Hello
0
210
14.00




SMTP Mail From
0
210
8.43




SMTP Rcpt To
0
160
6.09




SMTP Data
0
271
17.31




SMTP Quit
0
170
8.65




POP Connect
0
190
9.50




POP User ID
0
150
12.83




POP Password
0
1,863
51.90




POP Status
0
150
5.64




POP Retrieve
0
280
8.04




POP Delete
0
561
7.98




POP Quit
0
561
14.67




Function
Minimum Size
(KB)		
Maximum Size
(KB)		
Average Size
(KB)		




SMTP Data (KB up)
1
2,674
24.89




POP Retrieve (KB down)
1
2,675
25.08











Detailed Results -- 100% Load		




Load
User Count
Message Rate
(msg/min)		




Attempted
210,000
1,050




Actual
209,800
1,049




Function
Attempts
# Pass
QoS		
% Pass
QoS		




SMTP Connect
119,677
119,677
100.00%




SMTP Hello
119,677
119,677
100.00%




SMTP Mail From
119,676
119,676
100.00%




SMTP Rcpt To
239,260
239,260
100.00%




SMTP Data
119,672
119,672
100.00%




SMTP Quit
118,425
118,425
100.00%




POP Connect
125,893
125,893
100.00%




POP User ID
125,893
125,893
100.00%




POP Password
125,891
125,891
100.00%




POP Status
125,889
125,889
100.00%




POP Retrieve
127,249
127,249
100.00%




POP Delete
126,905
126,905
100.00%




POP Quit
125,541
125,541
100.00%




Delivery Time
1,219
1,208
99.10%




SMTP Data Response Time
119,672
118,426
98.96%




POP Retrieve Response Time
127,249
127,044
99.84%




Remote Message Delivery
114,636
113,487
99.00%





Counter		

Value		




SMTP Connect Error
0




SMTP Protocol Error
0




SMTP Disconnect
1,246




SMTP Session
118,425




SMTP To Local
124,624




SMTP To Remote
114,636




SINK Connect Error
0




POP Connect Error
1




POP Protocol Error
1




POP Disconnect
342




POP Session
125,542




Delivery Time Connect Error
0




Function
Minimum Time
(millisec)		
Maximum Time
(millisec)		
Average Time
(millisec)		




SMTP Connect
0
220
17.78




SMTP Hello
0
240
22.33




SMTP Mail From
0
230
16.31




SMTP Rcpt To
0
171
10.28




SMTP Data
0
310
30.85




SMTP Quit
0
180
12.73




POP Connect
0
180
11.17




POP User ID
0
151
15.99




POP Password
10
4,066
86.49




POP Status
0
150
9.80




POP Retrieve
0
1,692
12.72




POP Delete
0
791
13.30




POP Quit
0
811
26.83




Function
Minimum Size
(KB)		
Maximum Size
(KB)		
Average Size
(KB)		




SMTP Data (KB up)
1
2,674
24.16




POP Retrieve (KB down)
1
2,675
24.36











Detailed Results -- 120% Load		




Load
User Count
Message Rate
(msg/min)		




Attempted
252,000
1,260




Actual
251,000
1,255




Function
Attempts
# Pass
QoS		
% Pass
QoS		




SMTP Connect
143,501
143,501
100.00%




SMTP Hello
143,501
143,501
100.00%




SMTP Mail From
143,503
143,503
100.00%




SMTP Rcpt To
288,794
288,794
100.00%




SMTP Data
143,099
138,572
96.84%




SMTP Quit
141,673
141,673
100.00%




POP Connect
150,546
150,546
100.00%




POP User ID
150,547
150,547
100.00%




POP Password
150,554
149,271
99.15%




POP Status
150,554
150,554
100.00%




POP Retrieve
140,801
140,796
100.00%




POP Delete
140,406
140,404
100.00%




POP Quit
150,173
150,173
100.00%




Delivery Time
1,499
1,009
67.31%




SMTP Data Response Time
143,099
138,405
96.72%




POP Retrieve Response Time
140,801
140,584
99.85%




Remote Message Delivery
137,842
100,256
72.73%





Counter		

Value		




SMTP Connect Error
453




SMTP Protocol Error
0




SMTP Disconnect
1,426




SMTP Session
142,126




SMTP To Local
150,949




SMTP To Remote
137,842




SINK Connect Error
0




POP Connect Error
0




POP Protocol Error
0




POP Disconnect
399




POP Session
150,173




Delivery Time Connect Error
2




Function
Minimum Time
(millisec)		
Maximum Time
(millisec)		
Average Time
(millisec)		




SMTP Connect
0
281
35.10




SMTP Hello
0
321
42.11




SMTP Mail From
0
1,162
36.07




SMTP Rcpt To
0
241
20.60




SMTP Data
0
60,487
755.65




SMTP Quit
0
230
21.11




POP Connect
0
190
15.30




POP User ID
0
200
23.24




POP Password
10
33,027
303.35




POP Status
0
211
19.77




POP Retrieve
0
32,517
24.54




POP Delete
0
11,927
24.41




POP Quit
0
1,132
53.23




Function
Minimum Size
(KB)		
Maximum Size
(KB)		
Average Size
(KB)		




SMTP Data (KB up)
1
2,674
24.59




POP Retrieve (KB down)
1
2,675
24.51












General Notes / Tuning Information





The DNS server used for the test was running on a separate Windows 2000 server (Pentium III 733)
A UPS is required by the SUT









For questions about this result, please contact the tester.

For other inquiries, please contact
webmaster@spec.org

Copyright © 1999-2001 Standard Performance Evaluation Corporation



First published at SPEC.org on 28-Mar-2002


Benchmark run on Mon Mar 11 17:02:12 MST 2002 by SPECmail2001 v1.01

Report generated on Mon Apr 25 17:24:48 EDT 2005 by SPECmail2001 v1.05 HTML Formatter