SPEC Seal of Reviewal SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation
Mirapoint MSR 2.9 - M300 SPECmail2001 msgs/min = 300
SPEC license # 69 Tested by:
Mirapoint		 Test date:
Jun-2001		 Hardware Avail:
Mar-2001		 Software Avail:
Apr-2001

300 SPECmail2001 messages per minute is equivalent to 60,000 SPECmail2001_users.

Detail Summary | General Notes
System configurations: Internet Message Server - Message Store | Benchmark Manager | Load Generator | SMTP Sink | Configuration diagram
Detailed results: Detailed Results 80% load | Detailed Results 100% load | Detailed Results 120% load


Summary Results
Function Response
time limit
(seconds)		 Required
Percentage
Compliant		 Percentage Compliant
80% 100% 120%
SMTP Connect 5 >95% 100.00% 100.00% 100.00%
SMTP Data 5 >95% 100.00% 100.00% 99.25%
POP Connect 5 >95% 100.00% 100.00% 100.00%
POP Status 5 >95% 100.00% 100.00% 100.00%
POP Retrieve 5 >95% 100.00% 100.00% 100.00%
POP Delete 5 >95% 100.00% 100.00% 100.00%
Delivery Time 60 >95% 99.61% 99.75% 3.18%
Error Rate NA <1% 0.00% 0.00% 0.00%

Internet Message Server - Message Store (1 system)
Software
System Release: MSR 2.9 Operating System: MOS
Availability: Apr-2001 File System: MessageBase (tm)
Hardware
Vendor: Mirapoint CPU: Intel PIII
Model Name: M300 CPU MHz: 1000
Availability: Mar-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 3 x 36GB 10K RPM SCSI Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 768 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 1 Other: 1xRAID1 + Hot-spare
Notes / Tuning Information 
Hostname: mperf20

Licenses: User-limit unlimited, UPS Removal, POP unlimited users

CLI configuration commands:

    # Don't send system alerts, etc. to customercare@mirapoint.com
    conf disable customercare

    # Accept mail for the local domain
    maildom add local.p.net

    # Relay mail for the remote domain
    relay add remote.p.net

MSL is 30 seconds (not configurable)

TIME_WAIT is 60 seconds (not configurable)

MSS is 1460 bytes (not configurable)

Benchmark Manager (1 system)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_008 (symcjit) Operating System: Microsoft Windows NT Workstation 4.0 (service pack 5)
Availability: Apr-2001 File System: FAT
Hardware
Vendor: Hewlett-Packard CPU: AMD-K6-2
Model Name: Pavilion 4440 CPU MHz: 333
Availability: Jan-2000 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 4GB EIDE Primary Cache: 32KB(I) + 32KB(D) on chip
Memory (MB): 156 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information 
Hostname: operf9

MaxUserPort set to value 65534

Load Generator (2 systems)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_008 (symcjit) Operating System: Microsoft Windows NT Workstation 4.0 (service pack 5)
Availability: Apr-2001 File System: NTFS
Hardware
Vendor: FIT CPU: Intel PIII
Model Name: Server-1000 CPU MHz: 800
Availability: Jun-2000 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 30GB EIDE Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 256 Secondary Cache: 256KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 2 Other: N/A
Notes / Tuning Information 
Hostnames: operf10, operf11

MaxUserPort set to value 65534

SMTP Sink (1 system)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_008 (symcjit) Operating System: Microsoft Windows NT Workstation 4.0 (service pack 5)
Availability: Apr-2001 File System: NTFS
Hardware
Vendor: Dell CPU: Intel PIII
Model Name: PowerEdge 1400 CPU MHz: 933
Availability: Jun-2000 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 2 x 36GB U160 SCSI Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 768 Secondary Cache: 256KB
Network: 3COM 3C985B-SX (Gigabit EtherLink) Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information 
Hostname: operf4

Comment out line for SMTP in /WINNT/system32/drivers/etc/SERVICES
(required to allow the mail sink to bind to port 25)

MaxUserPort set to value 65534


Detailed Results -- 80% Load
Load User Count Message Rate
(msg/min)
Attempted 48,000 240
Actual 47,600 238
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 27,107 27,107 100.00%
SMTP Hello 27,107 27,107 100.00%
SMTP Mail From 27,107 27,107 100.00%
SMTP Rcpt To 53,938 53,938 100.00%
SMTP Data 27,106 27,106 100.00%
SMTP Quit 26,838 26,838 100.00%
POP Connect 28,669 28,669 100.00%
POP User ID 28,669 28,669 100.00%
POP Password 28,669 28,669 100.00%
POP Status 28,669 28,669 100.00%
POP Retrieve 28,623 28,623 100.00%
POP Delete 28,552 28,552 100.00%
POP Quit 28,614 28,614 100.00%
Delivery Time 255 254 99.61%
SMTP Data Response Time 27,106 26,838 99.01%
POP Retrieve Response Time 28,623 28,581 99.85%
Remote Message Delivery 25,019 24,779 99.04%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 268
SMTP Session 26,838
SMTP To Local 28,920
SMTP To Remote 25,019
SINK Connect Error 0
POP Connect Error 0
POP Protocol Error 0
POP Disconnect 71
POP Session 28,614
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 1,102 20.05
SMTP Hello 0 1,102 26.04
SMTP Mail From 0 1,252 24.91
SMTP Rcpt To 0 501 23.15
SMTP Data 0 841 27.71
SMTP Quit 0 571 12.33
POP Connect 0 361 9.45
POP User ID 0 410 13.65
POP Password 0 911 56.13
POP Status 0 360 2.94
POP Retrieve 0 441 25.16
POP Delete 0 351 4.96
POP Quit 0 751 14.83
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.06
POP Retrieve (KB down) 1 2,675 24.70


Detailed Results -- 100% Load
Load User Count Message Rate
(msg/min)
Attempted 60,000 300
Actual 60,200 301
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 34,234 34,234 100.00%
SMTP Hello 34,234 34,234 100.00%
SMTP Mail From 34,232 34,232 100.00%
SMTP Rcpt To 68,803 68,803 100.00%
SMTP Data 34,225 34,225 100.00%
SMTP Quit 33,885 33,885 100.00%
POP Connect 36,141 36,141 100.00%
POP User ID 36,141 36,141 100.00%
POP Password 36,142 36,142 100.00%
POP Status 36,142 36,142 100.00%
POP Retrieve 35,729 35,729 100.00%
POP Delete 35,630 35,630 100.00%
POP Quit 36,050 36,050 100.00%
Delivery Time 404 403 99.75%
SMTP Data Response Time 34,225 33,885 99.01%
POP Retrieve Response Time 35,729 35,664 99.82%
Remote Message Delivery 32,691 32,340 98.93%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 340
SMTP Session 33,885
SMTP To Local 36,112
SMTP To Remote 32,691
SINK Connect Error 0
POP Connect Error 0
POP Protocol Error 0
POP Disconnect 99
POP Session 36,050
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 1,082 40.97
SMTP Hello 0 1,102 47.40
SMTP Mail From 0 1,673 57.83
SMTP Rcpt To 0 1,041 36.21
SMTP Data 0 1,222 44.09
SMTP Quit 0 1,402 20.59
POP Connect 0 591 10.95
POP User ID 0 881 15.45
POP Password 0 1,172 101.29
POP Status 0 300 3.17
POP Retrieve 0 871 31.61
POP Delete 0 410 5.51
POP Quit 0 1,191 33.54
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 23.54
POP Retrieve (KB down) 1 2,675 25.95


Detailed Results -- 120% Load
Load User Count Message Rate
(msg/min)
Attempted 72,000 360
Actual 72,000 360
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 41,053 41,053 100.00%
SMTP Hello 41,053 41,053 100.00%
SMTP Mail From 41,064 40,056 97.55%
SMTP Rcpt To 81,391 81,391 100.00%
SMTP Data 41,066 40,759 99.25%
SMTP Quit 40,678 40,343 99.18%
POP Connect 43,271 43,271 100.00%
POP User ID 43,271 43,271 100.00%
POP Password 43,270 43,270 100.00%
POP Status 43,270 43,270 100.00%
POP Retrieve 40,237 40,237 100.00%
POP Delete 40,143 40,143 100.00%
POP Quit 43,189 43,184 99.99%
Delivery Time 409 13 3.18%
SMTP Data Response Time 41,066 40,489 98.59%
POP Retrieve Response Time 40,237 40,178 99.85%
Remote Message Delivery 38,043 24,758 65.08%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 391
SMTP Session 40,678
SMTP To Local 43,346
SMTP To Remote 38,043
SINK Connect Error 0
POP Connect Error 0
POP Protocol Error 0
POP Disconnect 94
POP Session 43,189
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 3,515 283.47
SMTP Hello 0 3,535 296.16
SMTP Mail From 0 23,714 1,050.55
SMTP Rcpt To 0 3,124 145.80
SMTP Data 0 20,950 373.95
SMTP Quit 0 19,709 347.82
POP Connect 0 1,031 17.40
POP User ID 0 1,061 23.27
POP Password 10 4,907 580.65
POP Status 0 410 4.33
POP Retrieve 0 1,041 42.09
POP Delete 0 932 8.08
POP Quit 0 6,510 267.22
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.25
POP Retrieve (KB down) 1 2,675 25.10

General Notes / Tuning Information 

Network hardware:

  Foundry Network ServerIronXL (2x 1000Base-SX ports and 24x 10/100 BaseT ports)

Switch configuration:

  Only layer three switching performed -- no particular switch
  configuration required.

DNS configuration:

  "A" records for every host on the network (to map hostnames to IP
  addresses).

  "PTR" records for every host on the network (to reverse map IP
  addresses to hostnames).

  Specify operf4.p.net as the only mail exchange for domain remote.p.net
  with an MX record of preference level 10.


Testing performed at Mirapoint Headquarters (Performance Lab) in Sunnyvale, CA.

For questions about this result, please contact the tester.
For other inquiries, please contact webmaster@spec.org
Copyright © 1999-2001 Standard Performance Evaluation Corporation

First published at SPEC.org on 05-Jul-2001

Benchmark run on Sun Jun 17 17:43:15 PDT 2001 by SPECmail2001 v1.01
Report generated on Mon Apr 25 17:24:26 EDT 2005 by SPECmail2001 v1.05 HTML Formatter