SPEC Seal of Reviewal SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation
Mirapoint MSR 3.2 - DS400/MD400/M4000 SPECmail2001 msgs/min = 5,000
SPEC license # 69 Tested by:
Mirapoint		 Test date:
Mar-2002		 Hardware Avail:
Mar-2002		 Software Avail:
Jun-2002

5,000 SPECmail2001 messages per minute is equivalent to 1,000,000 SPECmail2001_users.

Detail Summary | General Notes
System configurations: Internet Directory - LDAP Server | Message Director - Access Switch | Message Director - Router | Internet Message Server - Message Store | Benchmark Manager/SMTP Sink | Load Generator | Load Generator | Configuration diagram
Detailed results: Detailed Results 80% load | Detailed Results 100% load | Detailed Results 120% load


Summary Results
Function Response
time limit
(seconds)		 Required
Percentage
Compliant		 Percentage Compliant
80% 100% 120%
SMTP Connect 5 >95% 100.00% 100.00% 100.00%
SMTP Data 5 >95% 98.38% 100.00% 99.95%
POP Connect 5 >95% 100.00% 100.00% 100.00%
POP Status 5 >95% 100.00% 100.00% 100.00%
POP Retrieve 5 >95% 100.00% 100.00% 100.00%
POP Delete 5 >95% 99.99% 100.00% 100.00%
Delivery Time 60 >95% 99.06% 98.87% 98.94%
Error Rate NA <1% 0.01% 0.00% 0.00%

Internet Directory - LDAP Server (2 systems)
Software
System Release: MSR 3.2 Operating System: MOS
Availability: Jun-2002 File System: MessageBase (tm)
Hardware
Vendor: Mirapoint CPU: Intel PIII
Model Name: DS400 CPU MHz: 1400
Availability: Mar-2002 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 3 x 73GB 10K RPM SCSI Primary Cache: 32KB L1 cache on chip
Memory (MB): 2048 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 2 Other: 1xRAID1 + Hot-spare
Notes / Tuning Information 
Hostname: mperf1 (primary), mperf10 (replica)

Licenses: User-limit 20, SSH Licensed, Directory Server Access

LDAP Server configuration:

   Truncated LDIF contents (1M.ldif) used to populate the ldap database:

	dn: c=us
	objectclass: top
	objectclass: country
	c: us

	dn: o=spec1M,c=us
	objectclass: organization
	o: spec1M

	dn: miLoginid=u1,o=spec1M,c=us
	objectclass: top
	objectclass: mirapointUser
	objectclass: mirapointMailUser
	miLoginid: u1
	sn: u1
	cn: u1
	mail: u1@local.p.net
	maillocaladdress: u1
	mailhost: mperf5.p.net
	userPassword: u1

	...


  CLI configuration commands:

    # Don't send system alerts, etc. to customercare@mirapoint.com
    conf disable customercare

    # Create index for the miLoginid attribute
    dir addindex "" miLoginid eq,pres

    # Populate the LDAP database
    dir importldif "" ftp://mperf100.p.net/pub/1M.ldif

    # Setup primary LDAP server

    dir addreplica spec mirapoint c=us c=us
    dir setrepoption spec binddn cn=administrator
    dir setrepoption spec bindpw admin
    dir setrepoption spec master ldap://mperf1.p.net
    dir addrephost spec ldap://mperf10.p.net
    dir exportconfig

    # (Save the exported config to a file)

    # Setup replica LDAP server

    dir importconfig
    # (Paste in the config from exported file obtained on the primary)

MSL is 30 seconds (not configurable)

TIME_WAIT is 60 seconds (not configurable)

MSS is 1460 bytes (not configurable)

Message Director - Access Switch (1 system)
Software
System Release: MSR 3.2 Operating System: MOS
Availability: Jun-2002 File System: MessageBase (tm)
Hardware
Vendor: Mirapoint CPU: Intel PIII
Model Name: MD400 CPU MHz: 1400
Availability: Mar-2002 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 3 x 73GB SCSI Primary Cache: 32KB L1 cache on chip
Memory (MB): 2048 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 1 Other: 1xRAID1 + Hot-spare
Notes / Tuning Information 
Hostname: mperf2

Licenses: User-limit 20, LDAP Routing, POP 20 users

CLI configuration commands:

    # Don't send system alerts, etc. to customercare@mirapoint.com
    conf disable customercare

    # Enable per-user access switching
    pop set mode ldapproxy

    # Configure LDAP
    ldap add 10.5.1.10
    ldap setquery user:publishedname o=spec1M,c=us (mail=$(login)) mail
    ldap setquery user:mailhost o=spec1M,c=us (mail=$(login)) mailhost

    # Set the period that LDAP query results are cached internally
    ldap set cachetimeout 2h

MSL is 30 seconds (not configurable)

TIME_WAIT is 60 seconds (not configurable)

MSS is 1460 bytes (not configurable)

Message Director - Router (2 systems)
Software
System Release: MSR 3.2 Operating System: MOS
Availability: Jun-2002 File System: MessageBase (tm)
Hardware
Vendor: Mirapoint CPU: Intel PIII
Model Name: MD400 CPU MHz: 1400
Availability: Mar-2002 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 3 x 73GB SCSI Primary Cache: 32KB L1 cache on chip
Memory (MB): 2048 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 2 Other: 1xRAID1 + Hot-spare
Notes / Tuning Information 
Hostnames: mperf3, mperf4

Licenses: User-limit 20, LDAP Routing

CLI configuration commands:

    # Don't send system alerts, etc. to customercare@mirapoint.com
    conf disable customercare

    # Accept mail for the local domain
    maildom add local.p.net

    # Relay mail for remote domains
    relay add remote.p.net

    # Turn off authentication check to prevent unauthorized relaying
    smtp set smtpauth off

    # Enable option to minimize message queueing
    smtp set fastpath on

    # Perform per-user routing using LDAP mailhost lookups
    smtp set ldaprouting on

    # Configure LDAP (primary: 10.5.1.1; replica: 10.5.1.10)

       #(Point mperf3 to replica - command issued on mperf3)
        ldap add 10.5.1.10

       #(Point mperf4 to primary - command issued on mperf4)
        ldap add 10.5.1.1

    ldap setquery user:publishedname o=spec1M,c=us (miLoginid=$(mbox)) mail
    ldap setquery user:mailhost o=spec1M,c=us (miLoginid=$(mbox)) mailhost

    # Set the period that LDAP query results are cached internally
    ldap set cachetimeout 2h

MSL is 30 seconds (not configurable)

TIME_WAIT is 60 seconds (not configurable)

MSS is 1460 bytes (not configurable)

Internet Message Server - Message Store (5 systems)
Software
System Release: MSR 3.2 Operating System: MOS
Availability: Jun-2002 File System: MessageBase (tm)
Hardware
Vendor: Mirapoint CPU: Intel PIII
Model Name: M4000 CPU MHz: 1400
Availability: Mar-2002 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 14 x 73GB 10K RPM FCAL Primary Cache: 32KB L1 cache on chip
Memory (MB): 2048 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 5 Other: 1xRAID10 + 2 Hot-spare
Notes / Tuning Information 
Hostnames: mperf5, mperf6, mperf7, mperf8, and mperf9.

Licenses: User-limit unlimited, POP unlimited users

CLI configuration commands:

    # Don't send system alerts, etc. to customercare@mirapoint.com
    conf disable customercare

    # Accept mail for the local domain
    maildom add local.p.net

    # Turn off authentication check to prevent unauthorized relaying
    smtp set smtpauth off

    # Enable option to minimize message queueing
    smtp set fastpath on

    # Configure LDAP (for authentication)
    ldap add 10.5.1.1
    ldap setquery user:publishedname o=spec1M,c=us (miLoginid=$(mbox)) mail
    auth set default plaintext:ldap

MSL is 30 seconds (not configurable)

TIME_WAIT is 60 seconds (not configurable)

MSS is 1460 bytes (not configurable)

Benchmark Manager/SMTP Sink (1 system)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_009 (symcjit) Operating System: Microsoft Windows NT Workstation 4.0 (service pack 5)
Availability: Apr-2001 File System: NTFS
Hardware
Vendor: Dell CPU: Intel PIII
Model Name: PowerEdge 1400 CPU MHz: 933
Availability: Jun-2000 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 2 x 36GB U160 SCSI Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 768 Secondary Cache: 256KB
Network: 3COM 3C985B-SX (Gigabit EtherLink) Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information 
Hostname: operf4

Comment out line for SMTP in /WINNT/system32/drivers/etc/SERVICES
(required to allow the mail sink to bind to port 25)

MaxUserPort set to value 65534

Load Generator (4 systems)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_009 (symcjit) Operating System: Microsoft Windows 2000 Professional
Availability: Aug-2000 File System: NTFS
Hardware
Vendor: emachine CPU: Intel Celeron
Model Name: T1115 CPU MHz: 1000
Availability: Mar-2002 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 20GB EIDE Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 256 Secondary Cache: 256KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 4 Other: N/A
Notes / Tuning Information 
Hostnames: operf1, operf2, operf8, operf9

MaxUserPort set to value 65534

Load Generator (7 systems)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_009 (symcjit) Operating System: Microsoft Windows NT Workstation 4.0 (service pack 5)
Availability: Apr-2001 File System: NTFS
Hardware
Vendor: FIT CPU: Intel PIII
Model Name: Server-1000 CPU MHz: 800
Availability: Jun-2000 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 30GB EIDE Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 256 Secondary Cache: 256KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 7 Other: N/A
Notes / Tuning Information 
Hostnames: operf10, operf11, operf12, operf13, operf14, operf16, operf17

MaxUserPort set to value 65534


Detailed Results -- 80% Load
Load User Count Message Rate
(msg/min)
Attempted 800,000 4,000
Actual 799,600 3,998
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 455,998 455,998 100.00%
SMTP Hello 455,998 455,998 100.00%
SMTP Mail From 455,999 455,999 100.00%
SMTP Rcpt To 910,119 910,119 100.00%
SMTP Data 455,988 448,607 98.38%
SMTP Quit 451,366 451,366 100.00%
POP Connect 479,617 479,617 100.00%
POP User ID 479,620 479,620 100.00%
POP Password 479,590 449,115 93.65%
POP Status 479,590 479,590 100.00%
POP Retrieve 480,113 480,105 100.00%
POP Delete 478,831 478,793 99.99%
POP Quit 478,321 478,143 99.96%
Delivery Time 4,589 4,546 99.06%
SMTP Data Response Time 455,988 448,997 98.47%
POP Retrieve Response Time 480,113 479,394 99.85%
Remote Message Delivery 432,057 427,579 98.96%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 4,622
SMTP Session 451,366
SMTP To Local 478,057
SMTP To Remote 432,057
SINK Connect Error 0
POP Connect Error 76
POP Protocol Error 0
POP Disconnect 1,290
POP Session 478,397
Delivery Time Connect Error 1
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 1,125 8.16
SMTP Hello 0 468 11.15
SMTP Mail From 0 411 4.63
SMTP Rcpt To 0 411 7.04
SMTP Data 0 16,164 398.35
SMTP Quit 0 380 3.00
POP Connect 0 2,113 8.69
POP User ID 0 437 13.85
POP Password 0 50,693 912.26
POP Status 0 4,844 13.08
POP Retrieve 0 7,078 45.57
POP Delete 0 6,640 105.20
POP Quit 0 9,614 75.58
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.96
POP Retrieve (KB down) 1 2,675 24.93


Detailed Results -- 100% Load
Load User Count Message Rate
(msg/min)
Attempted 1,000,000 5,000
Actual 1,000,600 5,003
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 570,321 570,321 100.00%
SMTP Hello 570,322 570,322 100.00%
SMTP Mail From 570,321 570,321 100.00%
SMTP Rcpt To 1,138,164 1,138,164 100.00%
SMTP Data 570,347 570,346 100.00%
SMTP Quit 564,589 564,589 100.00%
POP Connect 600,306 600,306 100.00%
POP User ID 600,302 600,302 100.00%
POP Password 600,295 600,280 100.00%
POP Status 600,291 600,291 100.00%
POP Retrieve 599,128 599,128 100.00%
POP Delete 597,579 597,579 100.00%
POP Quit 598,725 598,725 100.00%
Delivery Time 5,684 5,620 98.87%
SMTP Data Response Time 570,347 564,590 98.99%
POP Retrieve Response Time 599,128 598,253 99.85%
Remote Message Delivery 541,146 535,669 98.99%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 5,757
SMTP Session 564,589
SMTP To Local 597,015
SMTP To Remote 541,146
SINK Connect Error 0
POP Connect Error 15
POP Protocol Error 0
POP Disconnect 1,553
POP Session 598,740
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 1,406 8.66
SMTP Hello 0 1,015 11.58
SMTP Mail From 0 370 4.80
SMTP Rcpt To 0 400 7.56
SMTP Data 0 5,720 115.73
SMTP Quit 0 1,015 3.16
POP Connect 0 1,093 9.38
POP User ID 0 430 14.68
POP Password 0 45,422 87.03
POP Status 0 625 6.88
POP Retrieve 0 1,122 20.45
POP Delete 0 521 10.95
POP Quit 0 1,593 29.08
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.33
POP Retrieve (KB down) 1 2,675 24.51


Detailed Results -- 120% Load
Load User Count Message Rate
(msg/min)
Attempted 1,200,000 6,000
Actual 1,202,800 6,014
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 686,401 686,401 100.00%
SMTP Hello 686,402 686,402 100.00%
SMTP Mail From 686,406 686,406 100.00%
SMTP Rcpt To 1,372,134 1,372,134 100.00%
SMTP Data 686,359 686,007 99.95%
SMTP Quit 679,541 679,541 100.00%
POP Connect 720,839 720,839 100.00%
POP User ID 720,839 720,839 100.00%
POP Password 720,799 720,658 99.98%
POP Status 720,800 720,800 100.00%
POP Retrieve 719,925 719,925 100.00%
POP Delete 718,103 718,103 100.00%
POP Quit 718,948 718,948 100.00%
Delivery Time 6,859 6,786 98.94%
SMTP Data Response Time 686,359 679,444 98.99%
POP Retrieve Response Time 719,925 718,870 99.85%
Remote Message Delivery 649,937 643,557 99.02%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 6,818
SMTP Session 679,541
SMTP To Local 722,201
SMTP To Remote 649,937
SINK Connect Error 0
POP Connect Error 20
POP Protocol Error 0
POP Disconnect 1,816
POP Session 718,968
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 2,906 9.84
SMTP Hello 0 937 12.49
SMTP Mail From 0 481 5.15
SMTP Rcpt To 0 1,000 8.43
SMTP Data 0 16,876 187.58
SMTP Quit 0 391 3.53
POP Connect 0 4,187 11.29
POP User ID 0 2,969 17.38
POP Password 10 45,766 199.73
POP Status 0 1,875 10.23
POP Retrieve 0 1,041 26.80
POP Delete 0 1,302 16.03
POP Quit 0 3,655 75.88
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.44
POP Retrieve (KB down) 1 2,675 24.79

General Notes / Tuning Information 

Network hardware:

   Foundry Network ServerIronXL (2x 1000Base-SX ports and 24x 10/100 BaseT ports)

   The Foundry switch is configured to perform SMTP server load balancing (SLB)
   for virtual host vmr1.p.net.  Accesses to the SMTP port of vmr1.p.net are
   load balanced across the SMTP ports of real hosts mperf3, mperf4
   using the round-robin SLB algorithm.

   Configuration commands:

        server real mperf3 10.5.1.3 port smtp

        server real mperf4 10.5.1.4 port smtp

        server virtual vmr1 10.5.10.1 predictor round-robin
          port smtp
          bind smtp mperf3 smtp mperf4

DNS configuration:

   "A" records for every host on the network (to map hostnames to IP
   addresses).

   "PTR" records for every host on the network (to reverse map IP
   addresses to hostnames).

   "PTR" and "A" records for the "virtual" host vmr1.p.net.

   Host alias "smtp.p.net" is mapped to vmr1.p.net (the virtual message
   router pool) with a CNAME record.

   Host alias "pop.p.net" is mapped to mperf2.p.net (the access
   switch) with a CNAME record.

   Specify operf4.p.net as the only mail exchange for domain remote.p.net
   with an MX record of preference level 10.


Testing performed at Mirapoint Headquarters (Performance Lab) in Sunnyvale, CA.

For questions about this result, please contact the tester.
For other inquiries, please contact webmaster@spec.org
Copyright © 1999-2001 Standard Performance Evaluation Corporation

First published at SPEC.org on 10-Apr-2002

Benchmark run on Wed Mar 13 02:19:55 PST 2002 by SPECmail2001 v1.01
Report generated on Mon Apr 25 17:24:27 EDT 2005 by SPECmail2001 v1.05 HTML Formatter