SPEC Seal of Reviewal SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation
HP StorageWorks Disk Array xp128 SPECmail2001 msgs/min = 6,250
SPEC license # 3 Tested by:
HP Storage Network Solutions		 Test date:
Apr-2003		 Hardware Avail:
Mar-2003		 Software Avail:
Jun-2002

6,250 SPECmail2001 messages per minute is equivalent to 1,250,000 SPECmail2001_users.

Detail Summary | General Notes
System configurations: HP Network Storage | Internet Directory - LDAP Server | Message Director - Router | Message Director - Access Switch | Internet Message Server - Message Store | Benchmark Manager | SMTP Sink | Load Generator | Configuration diagram
Detailed results: Detailed Results 80% load | Detailed Results 100% load | Detailed Results 120% load


Summary Results
Function Response
time limit
(seconds)		 Required
Percentage
Compliant		 Percentage Compliant
80% 100% 120%
SMTP Connect 5 >95% 100.00% 100.00% 100.00%
SMTP Data 5 >95% 100.00% 100.00% 99.99%
POP Connect 5 >95% 100.00% 100.00% 100.00%
POP Status 5 >95% 100.00% 100.00% 100.00%
POP Retrieve 5 >95% 100.00% 100.00% 100.00%
POP Delete 5 >95% 100.00% 100.00% 100.00%
Delivery Time 60 >95% 99.02% 99.00% 99.22%
Error Rate NA <1% 0.00% 0.01% 0.00%

HP Network Storage (1 system)
Software
SAN Software: Command View, LUN Configuration & Security Manager, Business Copy Operating System: Proprietary OS
Availability: Jun-2002 File System: N/A
Hardware
Vendor: Hewlett-Packard CPU: NEC/MIPS-32 ACP - Array Control Processor
Model Name: HP StorageWorks Disk Array xp128 CPU MHz: 160
Availability: May-2002 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: SAN - RAID0/1 (See attached Tuning Information section) Primary Cache: N/A
Memory (MB): 512MB - shared memory Secondary Cache: N/A
Network: None Other Cache: SAN - 16GB of storage cache
# of Systems: 1 Other: Fiber Card: Client Host Interface Processor CHIP - NEC/MIPS-32 200MHz
Notes / Tuning Information 
Network Storage Configuration
Number of disk drives				80
Disk drive capacity				73GB, 10,000 RPM
Number of array groups				20
Number of disks per array group			4
Array group RAID level				RAID0/1
Number of array groups used per MAS		4
Open-3 LDEV size				2.461GB
Number of Open-3 LDEVs used per array group	10
Number of Open-3 LDEVs used per MAS		40
Cache memory				16GB - dynamic write cache, mirror with independent power supply
Cache memory battery backup time	48 hours, minimum
Shared memory				512MB
Shared memory backup time		7 days
Number of 8-port CHIP Pair		1 - each with 8-port 200MHz NEC/MIPS-32 microprocessor 2Gb/s Auto-sensing FC/CA
Number of ACP Pair			1 - High Performance, 160MHz NEC/MIPS-32 microprocessor
microcode version			21.04.04

Internet Directory - LDAP Server (3 systems)
Software
System Release: MSR 3.3 Operating System: MOS
Availability: Jun-2002 File System: MessageBase (tm)
Hardware
Vendor: Mirapoint CPU: Intel PIII
Model Name: DS400 CPU MHz: 1400
Availability: Mar-2002 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 3 x 73GB 10K RPM SCSI (RAID1 w/2 disks + hot-spare) Primary Cache: 32KB L1 cache on chip
Memory (MB): 2048 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 3 Other: N/A
Notes / Tuning Information 
Hostname: mperf20 (primary), mperf21 (replica), mperf22 (replica)

Licenses: User-unlimited, Directory Server Access, SMTP FastPath

LDAP Server configuration:

   Truncated LDIF contents (HP1.25M.ldif) used to populate the ldap database:

	dn: c=us
	objectclass: top
	objectclass: country
	c: us

	dn: o=specHP1.25M,c=us
	objectclass: organization
	o: specHP1.25M

	dn: miLoginid=u1,o=specHP1.25M,c=us
	objectclass: top
	objectclass: mirapointUser
	objectclass: mirapointMailUser
	miLoginid: u1
	sn: u1
	cn: u1
	mail: u1@local.p.net
	maillocaladdress: u1
	mailhost: mperf11.p.net
	userPassword: u1

	...


  CLI configuration commands:

    # Don't send system alerts, etc. to customercare@mirapoint.com
    conf disable customercare

    # Create index for the miLoginid attribute
    dir addindex "" miLoginid eq,pres

    # Populate the LDAP database
    dir importldif "" ftp://mperf100.p.net/pub/hp1.25m.ldif

    # Setup primary LDAP server

    dir addreplica spec mirapoint c=us c=us
    dir setrepoption spec binddn cn=administrator
    dir setrepoption spec bindpw admin
    dir setrepoption spec master ldap://mperf20.p.net
    dir addrephost spec ldap://mperf21.p.net
    dir addrephost spec ldap://mperf22.p.net
    dir exportconfig

    # (Save the exported config to a file)

    # Setup replica LDAP server

    dir importconfig
    # (Paste in the config from exported file obtained on the primary)

MSL is 30 seconds (not configurable)

TIME_WAIT is 60 seconds (not configurable)

MSS is 1460 bytes (not configurable)

Message Director - Router (3 systems)
Software
System Release: MSR 3.3 Operating System: MOS
Availability: Jun-2002 File System: MessageBase (tm)
Hardware
Vendor: Mirapoint CPU: Intel PIII
Model Name: MD400 CPU MHz: 1400
Availability: Mar-2002 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 3 x 73GB 10K RPM SCSI (RAID1 w/2 disks + hot-spare) Primary Cache: 32KB L1 cache on chip
Memory (MB): 2048 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 3 Other: N/A
Notes / Tuning Information 
Hostnames: mperf2, mperf3, mperf4

Licenses: User-limit Unlimited, LDAP Routing, POP Unlimited, SMTP FastPath

CLI configuration commands:

    # Don't send system alerts, etc. to customercare@mirapoint.com
    conf disable customercare

    # Accept mail for the local domain
    maildom add local.p.net

    # Relay mail for remote domains
    relay add operf31.p.net

    # Turn off authentication check to prevent unauthorized relaying
    smtp set smtpauth off

    # Enable option to minimize message queueing
    smtp set fastpath on

    # Perform per-user routing using LDAP mailhost lookups
    smtp set ldaprouting all

    # Configure LDAP (primary: 10.5.1.20; replicas: 10.5.1.21 and 10.5.1.22)

       #(Point mperf2 to primary - command issued on mperf2)
        ldap add 10.5.1.20

       #(Point mperf3 and mperf4 to replica - command issued on mperf3 and mperf4)
        ldap add 10.5.1.22

    ldap setquery user:publishedname o=specHP1.25M,c=us (miLoginid=$(mbox)) mail
    ldap setquery user:mailhost o=specHP1.25M,c=us (miLoginid=$(mbox)) mailhost

    # Set the period that LDAP query results are cached internally
    ldap set cachetimeout 2h

MSL is 30 seconds (not configurable)

TIME_WAIT is 60 seconds (not configurable)

MSS is 1460 bytes (not configurable)

Message Director - Access Switch (2 systems)
Software
System Release: MSR 3.3 Operating System: MOS
Availability: Jun-2002 File System: MessageBase (tm)
Hardware
Vendor: Mirapoint CPU: Intel PIII
Model Name: MD400 CPU MHz: 1400
Availability: Mar-2002 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 3 x 73GB 10K RPM SCSI (RAID1 w/2 disks + hot-spare) Primary Cache: 32KB L1 cache on chip
Memory (MB): 2048 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 2 Other: N/A
Notes / Tuning Information 
Hostname: mperf5, mperf6

Licenses: User-limit 20, LDAP Routing, POP 20 users, SMTP FastPath

CLI configuration commands:

    # Don't send system alerts, etc. to customercare@mirapoint.com
    conf disable customercare

    # Enable per-user access switching
    pop set mode ldapproxy

    # Configure LDAP

    #(Point mperf5 and mperf6 to first replica - command issued on mperf5 and mperf6
    ldap add 10.5.1.21

    ldap setquery user:publishedname o=specHP1.25M,c=us (mail=$(login)) mail
    ldap setquery user:mailhost o=specHP1.25M,c=us (mail=$(login)) mailhost

    # Set the period that LDAP query results are cached internally
    ldap set cachetimeout 2h

MSL is 30 seconds (not configurable)

TIME_WAIT is 60 seconds (not configurable)

MSS is 1460 bytes (not configurable)

Internet Message Server - Message Store (5 systems)
Software
System Release: MSR 3.3 Operating System: MOS
Availability: Jun-2002 File System: MessageBase (tm)
Hardware
Vendor: Mirapoint CPU: Intel PIII
Model Name: M4000-S CPU MHz: 1400
Availability: Mar-2002 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 3x73GB 10k RPM SCSI (RAID1 w/2 disks + hot-spare) Primary Cache: 32KB L1 cache on chip
Memory (MB): 2048 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 5 Other: Fiber card: QLA 2200F/66mHz PCI (SAN connector)
Notes / Tuning Information 
Hostnames: mperf11, mperf12, mperf13, mperf14 and mperf15.

Licenses: User-limit unlimited, LDAP Routing, POP unlimited users, SAN Attached Storage, SMTP FastPath

CLI configuration commands:

    # Don't send system alerts, etc. to customercare@mirapoint.com
    conf disable customercare

    # Accept mail for the local domain
    maildom add local.p.net

    # Turn off authentication check to prevent unauthorized relaying
    smtp set smtpauth off

    # Enable option to minimize message queueing
    smtp set fastpath on

    # Configure LDAP (pointing to LDAP primary for authentication)
    ldap add 10.5.1.20
    ldap setquery user:publishedname o=specHP1.25M,c=us (miLoginid=$(mbox)) mail
    auth set default plaintext:ldap

MSL is 30 seconds (not configurable)

TIME_WAIT is 60 seconds (not configurable)

MSS is 1460 bytes (not configurable)

Benchmark Manager (1 system)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_009 (symcjit) Operating System: Microsoft Windows NT Workstation 4.0 (service pack 5)
Availability: Apr-2001 File System: FAT
Hardware
Vendor: Hewlett-Packard CPU: AMD-K6-2
Model Name: Pavilion 4440 CPU MHz: 333
Availability: Jun-2000 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 4GB SCSI Primary Cache: 32KB(I) + 32KB(D) on chip
Memory (MB): 156 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information 
Hostname: operf30

MaxUserPort set to value 65534

SMTP Sink (1 system)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_009 (symcjit) Operating System: Microsoft Windows 2000 Professional
Availability: Apr-2001 File System: NTFS
Hardware
Vendor: Hewlett-Packard CPU: Intel Xeon
Model Name: ProLiant ML370 Server CPU MHz: 2400
Availability: Mar-2003 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 1 x 36.4GB Ultra 320 SCSI Primary Cache:
Memory (MB): 2GB Secondary Cache: 512KB
Network: 1 NC7781 Gigabit NIC Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information 
Hostname: operf31

Comment out line for SMTP in /WINNT/system32/drivers/etc/SERVICES
(required to allow the mail sink to bind to port 25)

MaxUserPort set to value 65534

Load Generator (5 systems)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_009 (symcjit) Operating System: Microsoft Windows 2000 Professional
Availability: Apr-2001 File System: NTFS
Hardware
Vendor: Hewlett-Packard CPU: Intel Xeon
Model Name: ProLiant ML370 Server CPU MHz: 2400
Availability: Mar-2003 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 1 x 36.4GB Ultra 320 SCSI Primary Cache:
Memory (MB): 2GB Secondary Cache: 512KB
Network: 1 x NC7781 Gigabit NIC Other Cache: N/A
# of Systems: 5 Other: N/A
Notes / Tuning Information 
Hostnames: operf32, operf33, operf34, operf35, operf36

MaxUserPort set to value 65534


Detailed Results -- 80% Load
Load User Count Message Rate
(msg/min)
Attempted 1,000,000 5,000
Actual 1,000,000 5,000
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 569,964 569,964 100.00%
SMTP Hello 569,963 569,963 100.00%
SMTP Mail From 569,962 569,962 100.00%
SMTP Rcpt To 1,134,715 1,134,715 100.00%
SMTP Data 570,025 570,025 100.00%
SMTP Quit 564,306 564,306 100.00%
POP Connect 599,965 599,965 100.00%
POP User ID 599,965 599,965 100.00%
POP Password 599,946 599,769 99.97%
POP Status 599,947 599,947 100.00%
POP Retrieve 597,312 597,312 100.00%
POP Delete 595,764 595,764 100.00%
POP Quit 598,394 598,394 100.00%
Delivery Time 5,839 5,782 99.02%
SMTP Data Response Time 570,025 564,305 99.00%
POP Retrieve Response Time 597,312 596,423 99.85%
Remote Message Delivery 537,381 531,919 98.98%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 5,719
SMTP Session 564,306
SMTP To Local 597,334
SMTP To Remote 537,381
SINK Connect Error 0
POP Connect Error 32
POP Protocol Error 0
POP Disconnect 1,546
POP Session 598,426
Delivery Time Connect Error 1
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 359 6.50
SMTP Hello 0 312 9.16
SMTP Mail From 0 250 5.37
SMTP Rcpt To 0 359 8.22
SMTP Data 0 2,516 74.28
SMTP Quit 0 297 3.82
POP Connect 0 1,563 5.36
POP User ID 0 1,563 13.67
POP Password 0 45,250 60.73
POP Status 0 703 5.74
POP Retrieve 0 968 14.76
POP Delete 0 656 8.37
POP Quit 0 1,016 12.84
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.39
POP Retrieve (KB down) 1 2,675 24.78


Detailed Results -- 100% Load
Load User Count Message Rate
(msg/min)
Attempted 1,250,000 6,250
Actual 1,249,800 6,249
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 713,243 713,243 100.00%
SMTP Hello 713,244 713,244 100.00%
SMTP Mail From 713,244 713,244 100.00%
SMTP Rcpt To 1,422,622 1,422,622 100.00%
SMTP Data 713,215 713,214 100.00%
SMTP Quit 706,038 706,038 100.00%
POP Connect 749,107 749,107 100.00%
POP User ID 749,108 749,108 100.00%
POP Password 749,012 748,834 99.98%
POP Status 749,012 749,012 100.00%
POP Retrieve 747,107 747,107 100.00%
POP Delete 745,091 745,091 100.00%
POP Quit 747,092 747,092 100.00%
Delivery Time 7,079 7,008 99.00%
SMTP Data Response Time 713,215 706,038 98.99%
POP Retrieve Response Time 747,107 746,024 99.86%
Remote Message Delivery 672,695 665,886 98.99%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 7,178
SMTP Session 706,038
SMTP To Local 749,930
SMTP To Remote 672,695
SINK Connect Error 0
POP Connect Error 93
POP Protocol Error 0
POP Disconnect 2,018
POP Session 747,185
Delivery Time Connect Error 1
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 360 6.96
SMTP Hello 0 359 9.64
SMTP Mail From 0 250 5.40
SMTP Rcpt To 0 360 8.88
SMTP Data 0 5,343 100.37
SMTP Quit 0 328 4.02
POP Connect 0 3,000 5.98
POP User ID 0 610 13.96
POP Password 0 46,172 96.39
POP Status 0 609 6.30
POP Retrieve 0 906 16.92
POP Delete 0 953 9.94
POP Quit 0 1,828 21.35
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.67
POP Retrieve (KB down) 1 2,675 24.78


Detailed Results -- 120% Load
Load User Count Message Rate
(msg/min)
Attempted 1,500,000 7,500
Actual 1,499,800 7,499
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 854,020 854,020 100.00%
SMTP Hello 854,020 854,020 100.00%
SMTP Mail From 854,020 854,020 100.00%
SMTP Rcpt To 1,710,739 1,710,739 100.00%
SMTP Data 853,990 853,908 99.99%
SMTP Quit 845,564 845,564 100.00%
POP Connect 900,684 900,683 100.00%
POP User ID 900,684 900,684 100.00%
POP Password 900,736 900,665 99.99%
POP Status 900,737 900,737 100.00%
POP Retrieve 893,592 893,592 100.00%
POP Delete 891,272 891,272 100.00%
POP Quit 898,469 898,469 100.00%
Delivery Time 8,611 8,544 99.22%
SMTP Data Response Time 853,990 845,558 99.01%
POP Retrieve Response Time 893,592 892,268 99.85%
Remote Message Delivery 811,322 803,309 99.01%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 8,424
SMTP Session 845,564
SMTP To Local 899,416
SMTP To Remote 811,322
SINK Connect Error 0
POP Connect Error 22
POP Protocol Error 0
POP Disconnect 2,322
POP Session 898,491
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 1,000 7.85
SMTP Hello 0 500 10.60
SMTP Mail From 0 313 5.58
SMTP Rcpt To 0 1,016 10.93
SMTP Data 0 8,156 147.80
SMTP Quit 0 484 4.46
POP Connect 0 9,062 7.61
POP User ID 0 3,156 15.00
POP Password 0 45,688 312.14
POP Status 0 1,422 7.82
POP Retrieve 0 1,641 20.45
POP Delete 0 1,594 12.82
POP Quit 0 2,656 43.80
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.54
POP Retrieve (KB down) 1 2,675 24.89

General Notes / Tuning Information 

Network switch:
   Foundry Network ServerIronXL (2x 1000Base-SX ports and 24x 10/100 BaseT ports)
   The Foundry switch is configured to perform SMTP server load balancing (SLB)
   for virtual host vmr1.p.net.  Accesses to the SMTP port of vmr1.p.net are
   load balanced across the SMTP ports of real hosts mperf2, mperf3, mperf4
   The Foundry switch is configured to perform POP3 server load balancing (SLB)
   for virtual host vsw1.p.net.  Accesses to the POP3 port of vsw1.p.net are
   load balanced across the POP3 ports of real hosts mperf5, mperf6
   using the round-robin SLB algorithm.
   Configuration commands:
        server real mperf2 10.5.1.2 port smtp
        server real mperf3 10.5.1.3 port smtp
        server real mperf4 10.5.1.4 port smtp
        server virtual vmr1 10.5.10.1 predictor round-robin
          port smtp
          bind smtp mperf2 smtp mperf3 smtp mperf4
        server real mperf5 10.5.1.5 port pop3
        server real mperf6 10.5.1.6 port pop3
        server virtual vsw1 10.5.10.2 predictor round-robin
          port pop3
          bind pop3 mperf5 pop3 mperf6

DNS configuration:
   "A" records for every host on the network (to map hostnames to IP
   addresses).
   "PTR" records for every host on the network (to reverse map IP
   addresses to hostnames).
   "PTR" and "A" records for the "virtual" host vmr1.p.net.
   Host alias "smtp.p.net" is mapped to vmr1.p.net (the virtual message
   router pool) with a CNAME record.
   Host alias "pop.p.net" is mapped to vsw1.p.net (the virtual access switch)
   with a CNAME record.

SAN switch:
   Brocade Silkworm 2800 (16 Universal ports)
   Performance: 1.0625 Gb/sec line speed, full duplex
   Switch Bandwidth: 16 Gb/sec end-to-end
   Switch Core: Non-blocking
   Fabric Latency: < 2 microseconds with no contention, cut through routing
   Maximum Frame Size: 2112-byte payload
   Frame Buffers: 448 dynamically allocated

Testing performed at Mirapoint Headquarters (Performance Lab) in Sunnyvale, CA.

For questions about this result, please contact the tester.
For other inquiries, please contact webmaster@spec.org
Copyright © 1999-2001 Standard Performance Evaluation Corporation

First published at SPEC.org on 04-Jun-2003

Benchmark run on Mon Apr 28 02:19:55 PST 2003 by SPECmail2001 v1.01
Report generated on Mon Apr 25 17:23:51 EDT 2005 by SPECmail2001 v1.05 HTML Formatter