SPEC Seal of Reviewal SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation
SPECMail2001 on Sun Fire V480/V880 and SUN Solaris with Sun Java System Messaging Server 6.1 SPECmail2001 msgs/min = 7,500
SPEC license # 6 Tested by:
Sun Microsystems		 Test date:
Oct-2004		 Hardware Avail:
Nov-2003		 Software Avail:
Nov-2004

7,500 SPECmail2001 messages per minute is equivalent to 1,500,000 SPECmail2001_users.

Detail Summary | General Notes
System configurations: POPSTORE Server | SMTPMTA Server | LDAP server | MMP-Message Multiplexor server | Benchmark Manager and Load Generator | Load Generator and Sink | Load Generator | Configuration diagram
Detailed results: Detailed Results 80% load | Detailed Results 100% load | Detailed Results 120% load


Summary Results
Function Response
time limit
(seconds)		 Required
Percentage
Compliant		 Percentage Compliant
80% 100% 120%
SMTP Connect 5 >95% 100.00% 100.00% 100.00%
SMTP Data 5 >95% 100.00% 100.00% 100.00%
POP Connect 5 >95% 100.00% 98.79% 73.78%
POP Status 5 >95% 100.00% 100.00% 100.00%
POP Retrieve 5 >95% 100.00% 100.00% 100.00%
POP Delete 5 >95% 100.00% 100.00% 100.00%
Delivery Time 60 >95% 98.91% 99.24% 93.90%
Error Rate NA <1% 0.00% 0.00% 2.52%

POPSTORE Server (2 systems)
Software
Software Release: Sun Java System Messaging Server 6.1HF.02 Operating System: Solaris 9[TM] 12/03 Operating Environment
Availability: Sep-2004 File System: ufs
Hardware
Vendor: SUN Microsystems Inc. CPU: UltraSparc III Cu
Model Name: Sun Fire V480 CPU MHz: 1200
Availability: Oct-2003 CPUs Enabled: 4
Disk Subsystem: 2x36GB SCSI, 4xSS3310-3364GB SCSI RAID0, 1xT3-303GB FCAL RAID0 Primary Cache: 32KB(I) + 64KB(D) on chip
Memory (MB): 16384 Secondary Cache: 8MB(I+D) off chip
Network: 1 Sun[TM] Gigaswift Ethernet onboard Controller, 1Gb/s Other Cache: None
# of Systems: 2 Other: N/A
Notes / Tuning Information 
*Each POPSTORE server connects with 4 Sun StorEdge SS3310 SCSI RAID0 array of 12x36GB disks
 with blocksize 16k, 512MB 72 hour battery backed up write back cache for Mail store, and 1
 Sun StorEdge T3 FCAL RAID0 array of 9 disks blocksize 16K, 1GB 72 hour battery backed up
 writeback cache for Mail store
*POPSTORE Tuning only not any installation steps:
  service.pop.numprocesses=8
 *STORE Tuning :
  store.dbcachesize=640000000
  store.dbtmpdir=/tmp/mboxlist

SMTPMTA Server (1 system)
Software
Software Release: Sun Java System Messaging Server 6.1HF.02 Operating System: Solaris 9[TM] 12/03 Operating Environment
Availability: Sep-2004 File System: ufs
Hardware
Vendor: SUN Microsystems Inc. CPU: UltraSparc III Cu
Model Name: Sun Fire V880 CPU MHz: 1200
Availability: Sep-2003 CPUs Enabled: 8
Disk Subsystem: 2x36GB SCSI, 1xT3-303GB FCAL RAID0 Primary Cache: 32KB(I) + 64KB(D) on chip
Memory (MB): 16384 Secondary Cache: 8MB(I+D) off chip
Network: 1 Sun[TM] Gigaswift Ethernet external Controller, 1Gb/s Other Cache: None
# of Systems: 1 Other: N/A
Notes / Tuning Information 
*The SMTPMTA server connects with 1 Sun StorEdge[TM] 3310 SCSI array of
 12x36GB disks, RAID0, blocksize 16K, 512MB 72 hour battery backed up write back
 cache for SMTP log and queue
*SMTPMTA Tuning only not any installtion steps:
  MIN_PROCS=20
  MAX_PROCS=240
  MIN_CONNS=20
  MAX_CONNS=50
  max_handoffs=100
 *Job Controller Tuning:
 IMS-POOL job-limit=12
 MAX_MESSAGES=1000000

LDAP server (1 system)
Software
Software Release: Sun Java System Directory Server 5.2 Operating System: Solaris 8[TM] 02/04 Operating Environment
Availability: Jun-2003 File System: ufs
Hardware
Vendor: SUN Microsystems Inc. CPU: UltraSparc III Cu
Model Name: Sun Fire V880 CPU MHz: 1200
Availability: Sep-2003 CPUs Enabled: 8
Disk Subsystem: 2x26GB SCSI, 1xSS3310-314GB SCSI JBOD RAID0 Primary Cache: 32KB(I) + 64KB(D) on chip
Memory (MB): 16384 Secondary Cache: 8MB(I+D) off chip
Network: 1 Sun[TM] Gigabit Ethernet external Controller, 1Gb/s Other Cache: None
# of Systems: 1 Other: N/A
Notes / Tuning Information 
*The LDAP server connects with 1 Sun StorEdge[TM] 3310 SCSI JBOD array of
 12x36GB disks, RAID0 blocksize 16K
*LDAP Tuning only not any installtion steps:
  nsslapd-dbcachesize=3600000000
  nsslapd-maxdescriptors=65536

MMP-Message Multiplexor server (1 system)
Software
Software Release: Sun Java System Messaging Server 6.1HF.05 Operating System: Solaris 8[TM] 02/04 Operating Environment
Availability: Nov-2004 File System: ufs
Hardware
Vendor: SUN Microsystems Inc. CPU: UltraSparc III Cu
Model Name: Sun Fire V480 CPU MHz: 1200
Availability: Oct-2003 CPUs Enabled: 4
Disk Subsystem: 2x36GB SCSI Primary Cache: 32KB(I) + 64KB(D) on chip
Memory (MB): 32768 Secondary Cache: 8MB(I+D) off chip
Network: 1 Sun[TM] Gigaswift Ethernet onboard Controller, 1Gb/s Other Cache: None
# of Systems: 1 Other: N/A
Notes / Tuning Information 
*MMP Tuning only not any installtion steps:
  default:ConnLimits=30000
  default:NumThreads=4
*MMP used 2 internal disks 36GB for the OS and the Multiplexor software
*No external storage was used for the MMP server

Benchmark Manager and Load Generator (1 system)
Software
JVM: Sun[TM] Java(TM) 2 Runtime Environment, Standard Edition Version 1.4.2_04(no JIT) (no JIT) Operating System: Solaris 9[TM] 03/04 Operating Environment
Availability: Mar-2004 File System: ufs
Hardware
Vendor: SUN Microsystems Inc. CPU: UltraSparc IIIi
Model Name: Sun Fire V440 CPU MHz: 1281
Availability: Nov-2003 CPUs Enabled: 4
Disk Subsystem: 2x36GB SCSI Primary Cache: 32KB(I) + 64KB(D) on chip
Memory (MB): 16384 Secondary Cache: 1MB(I+D) on chip
Network: 1 Sun[TM] Gigaswift Ethernet onboard Controller, 1Gb/s Other Cache: None
# of Systems: 1 Other: N/A
Notes / Tuning Information 
No special tuning

Load Generator and Sink (1 system)
Software
JVM: Sun[TM] Java(TM) 2 Runtime Environment, Standard Edition Version 1.4.2_04(no JIT) (no JIT) Operating System: Solaris 9[TM] 03/04 Operating Environment
Availability: Mar-2004 File System: ufs
Hardware
Vendor: SUN Microsystems Inc. CPU: UltraSparc IIIi
Model Name: Sun Fire V440 CPU MHz: 1281
Availability: Nov-2003 CPUs Enabled: 4
Disk Subsystem: 2x36GB SCSI Primary Cache: 32KB(I) + 64KB(D) on chip
Memory (MB): 16384 Secondary Cache: 1MB(I+D) on chip
Network: 1 Sun[TM] Gigaswift Ethernet onboard Controller, 1Gb/s Other Cache: None
# of Systems: 1 Other: N/A
Notes / Tuning Information 
No special tuning

Load Generator (2 systems)
Software
JVM: Sun[TM] Java(TM) 2 Runtime Environment, Standard Edition Version 1.4.2_04(no JIT) (no JIT) Operating System: Solaris 9[TM] 03/04 Operating Environment
Availability: Mar-2004 File System: ufs
Hardware
Vendor: SUN Microsystems Inc. CPU: UltraSparc IIIi
Model Name: Sun Fire V440 CPU MHz: 1281
Availability: Nov-2003 CPUs Enabled: 4
Disk Subsystem: 2x36GB SCSI Primary Cache: 32KB(I) + 64KB(D) on chip
Memory (MB): 16384 Secondary Cache: 1MB(I+D) on chip
Network: 1 Sun[TM] Gigaswift Ethernet onboard Controller, 1Gb/s Other Cache: None
# of Systems: 2 Other: N/A
Notes / Tuning Information 
No special tuning


Detailed Results -- 80% Load
Load User Count Message Rate
(msg/min)
Attempted 1,200,000 6,000
Actual 1,198,800 5,994
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 684,919 684,919 100.00%
SMTP Hello 684,916 684,916 100.00%
SMTP Mail From 684,917 684,917 100.00%
SMTP Rcpt To 1,369,228 1,369,228 100.00%
SMTP Data 684,907 684,907 100.00%
SMTP Quit 678,122 678,122 100.00%
POP Connect 717,518 717,515 100.00%
POP User ID 717,518 717,518 100.00%
POP Password 717,510 717,510 100.00%
POP Status 717,513 717,513 100.00%
POP Retrieve 719,642 719,642 100.00%
POP Delete 717,660 717,660 100.00%
POP Quit 715,525 715,525 100.00%
Delivery Time 6,671 6,598 98.91%
SMTP Data Response Time 684,907 678,125 99.01%
POP Retrieve Response Time 719,642 718,604 99.86%
Remote Message Delivery 646,015 639,479 98.99%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 6,782
SMTP Session 678,122
SMTP To Local 723,215
SMTP To Remote 646,015
SINK Connect Error 0
POP Connect Error 0
POP Protocol Error 0
POP Disconnect 1,989
POP Session 715,525
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 2 1,118 16.38
SMTP Hello 1 1,150 28.69
SMTP Mail From 0 1,204 18.70
SMTP Rcpt To 0 1,117 20.01
SMTP Data 0 1,428 40.24
SMTP Quit 0 1,110 14.28
POP Connect 5 6,581 64.60
POP User ID 6 1,346 89.87
POP Password 55 3,521 122.56
POP Status 8 1,223 49.40
POP Retrieve 14 1,509 57.37
POP Delete 14 1,210 48.27
POP Quit 14 3,739 60.83
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.43
POP Retrieve (KB down) 1 2,675 24.66


Detailed Results -- 100% Load
Load User Count Message Rate
(msg/min)
Attempted 1,500,000 7,500
Actual 1,500,400 7,502
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 855,204 855,204 100.00%
SMTP Hello 855,208 855,208 100.00%
SMTP Mail From 855,207 855,207 100.00%
SMTP Rcpt To 1,714,099 1,714,099 100.00%
SMTP Data 855,208 855,208 100.00%
SMTP Quit 846,795 846,795 100.00%
POP Connect 900,320 889,434 98.79%
POP User ID 900,313 900,312 100.00%
POP Password 900,315 900,315 100.00%
POP Status 900,312 900,312 100.00%
POP Retrieve 900,150 900,150 100.00%
POP Delete 897,776 897,776 100.00%
POP Quit 897,998 897,998 100.00%
Delivery Time 8,693 8,627 99.24%
SMTP Data Response Time 855,208 846,794 99.02%
POP Retrieve Response Time 900,150 898,902 99.86%
Remote Message Delivery 811,591 803,320 98.98%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 8,414
SMTP Session 846,795
SMTP To Local 902,504
SMTP To Remote 811,591
SINK Connect Error 0
POP Connect Error 18
POP Protocol Error 0
POP Disconnect 2,375
POP Session 898,016
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 2 1,478 16.93
SMTP Hello 1 1,743 29.67
SMTP Mail From 0 1,725 18.92
SMTP Rcpt To 0 1,563 20.84
SMTP Data 0 1,706 43.24
SMTP Quit 0 1,716 14.73
POP Connect 10 179,101 483.40
POP User ID 7 7,247 110.07
POP Password 73 4,380 158.55
POP Status 6 1,735 62.11
POP Retrieve 22 4,857 71.47
POP Delete 21 1,632 58.93
POP Quit 21 4,052 69.37
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.40
POP Retrieve (KB down) 1 2,675 24.55


Detailed Results -- 120% Load
Load User Count Message Rate
(msg/min)
Attempted 1,800,000 9,000
Actual 1,757,400 8,787
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 1,027,731 1,027,731 100.00%
SMTP Hello 1,027,730 1,027,730 100.00%
SMTP Mail From 1,027,727 1,027,727 100.00%
SMTP Rcpt To 2,051,353 2,051,353 100.00%
SMTP Data 1,027,698 1,027,698 100.00%
SMTP Quit 1,017,198 1,017,198 100.00%
POP Connect 1,027,076 757,773 73.78%
POP User ID 1,027,059 1,027,018 100.00%
POP Password 1,027,056 1,027,056 100.00%
POP Status 1,027,062 1,027,062 100.00%
POP Retrieve 1,034,755 1,034,755 100.00%
POP Delete 1,031,941 1,031,941 100.00%
POP Quit 1,024,167 1,024,167 100.00%
Delivery Time 10,239 9,614 93.90%
SMTP Data Response Time 1,027,698 1,017,199 98.98%
POP Retrieve Response Time 1,034,755 1,033,280 99.86%
Remote Message Delivery 972,017 962,098 98.98%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 10,499
SMTP Session 1,017,198
SMTP To Local 1,079,342
SMTP To Remote 972,017
SINK Connect Error 0
POP Connect Error 53,117
POP Protocol Error 0
POP Disconnect 2,816
POP Session 1,077,284
Delivery Time Connect Error 533
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 2 3,375 22.14
SMTP Hello 0 2,933 35.40
SMTP Mail From 0 2,480 19.55
SMTP Rcpt To 0 2,399 22.29
SMTP Data 0 4,549 49.43
SMTP Quit 0 2,181 15.65
POP Connect 8 181,858 11,414.31
POP User ID 9 59,918 126.91
POP Password 91 4,487 192.29
POP Status 8 2,372 73.02
POP Retrieve 26 4,619 82.73
POP Delete 26 2,422 69.02
POP Quit 27 4,589 79.27
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.62
POP Retrieve (KB down) 1 2,675 24.63

General Notes / Tuning Information 
Following are the OS Tunings only for all the Servers and clients, not any Installation steps:
 *set maxusers=2048: Number of concurrent users on the system determining the amount
  of physical memory allocated to the kernel
 *set maxphys=8388608: Hard limit on the open file descriptors for a single process
 *set rlim_fd_max=1048576: Hard limit on the open file descriptors for a single process
 *set autoup=600: Controls the frequency in seconds of entire physical memory to
  be scanned for dirty pages
 *set tune_t_fsflusher=1: Reduces fsflush daemon overhead
 *set ufs:ufs_HW=1572864: Limit the amount of I/O that may be outstanding
  to a single file on a system-wide basis
 *set ufs_LW=1048576: When ufs_HW bytes are outstanding, I/O requests will
  sleep until less than ufs_LW bytes are outstanding
 *set sq_max_size=512: The depth of the syncq (number of messages) before a
  destination streams queue generates a QFULL
 *set segmap_percent=64: Amount of memory used, to hold file system pages
 *set shmsys:shminfo_shmmax=0xffffffffffffffff: Maximum size in bytes of a shared memory segment
 *set shmsys:shminfo_shmseg=512: Maximum number of semaphores in the system
 *set shmsys:shminfo_shmmni=4096: Systemwide maximum number of semaphore undo structures
 *set semsys:seminfo_semmsl=340: Maximum number of semaphores per semaphore set
 *set semsys:seminfo_semmni=320: Establishes the maximum number of systemwide semaphore sets
 *set msgsys:msginfo_msgmax=16384: Maximum size a message can be, in bytes
 *set msgsys:msginfo_msgmnb=16384: Maximum number of bytes on a message queue
 *set msgsys:msginfo_msgmni=2200: Number of message queue identifier
 *set msgsys:msginfo_msgtql=2500: Maximum number of message headers
 *set msgsys:msginfo_msgseg=32767: The number of units of space that can be allocated
  from the memory map segment
 *set msgsys:msginfo_msgssz=128: Maximum message segment size
 *set msgsys:msginfo_msgmap=200: Number of entries in the message map
Following are the NETWORK Configuration and Tunings:
 *One Asente, GX5-1400 Gigabit Workgroup Switch is used for the network and routing
 *All 4 clients are connected to the switch via 1 Sun[TM] Gigaswift Ethernet on board controller/client, 1Gbit/s
 *2 POPSTORE servers and the MMP server are connected to the switch via 1 Sun[TM] Gigaswift Ethernet
  on board controller/server, 1Gbit/s
 *The SMTPMTA server and the LDAP server are connected to the switch via 1 Sun[TM] Gigaswift Ethernet external
  controller/server, 1Gbit/s
 *All the network connections and the routing are resolved using UNIX hosts file
 *set ce:ce_bcopy_thresh=96: The mblk size threshold used to decode when to copy a mblk
  into a pre-mapped buffer, or use DMA methods
 *set ce:ce_taskq_disable=1: Disables the use of Task queues and forces all packets to go
  up to layer 3 in the interrupt contest
 *set ce:dvma_thresh=95: The mblk size threshold used to decide when to use the fast path
  DVMA interface to transmit mblk
 *set ce:ce_reclaim_pending=16: This is the threshold for when reclaims start happening
 *set ce:ce_tx_ring_size=8192: This value is the size of each Tx descriptor
 *set tcp:tcp_conn_hash_size=262144
 */usr/sbin/ndd -set /dev/tcp tcp_recv_hiwat 65536
 */usr/sbin/ndd -set /dev/tcp tcp_xmit_hiwat 65536
 */usr/sbin/ndd -set /dev/tcp tcp_conn_req_max_q 16384
 */usr/sbin/ndd -set /dev/tcp tcp_conn_req_max_q0 16384
 */usr/sbin/ndd -set /dev/tcp tcp_smallest_anon_port 8192
 */usr/sbin/ndd -set /dev/ip  ip_ignore_redirect 1
 */usr/sbin/ndd -set /dev/tcp tcp_keepalive_interval 30000
 */usr/sbin/ndd -set /dev/tcp tcp_naglim_def 1
 */usr/sbin/ndd -set /dev/tcp tcp_mss_min 108
 */usr/sbin/ndd -set /dev/ip ip_respond_to_echo_broadcast 0
 */usr/sbin/ndd -set /dev/ip ip_forward_directed_broadcasts 0
 */usr/sbin/ndd -set /dev/tcp tcp_time_wait_interval 60000
 */usr/sbin/ndd -set /dev/ce instance 1
 */usr/sbin/ndd -set /dev/ce rx_intr_time 500
 */usr/sbin/ndd -set /dev/ce rx_intr_pkts 24
*MSL is 30 seconds, TIME_WAIT is 60 seconds, MTU is 1500 bytes (equates to MSS 1460 bytes): Fixed parameters

Reference: Sun Java System Messaging Server 6.1, Tuning Guide: http://docs.sun.com
The benchmark was conducted at the Sun's Performance lab in Burlington, Mass

For questions about this result, please contact the tester.
For other inquiries, please contact webmaster@spec.org
Copyright © 1999-2001 Standard Performance Evaluation Corporation

First published at SPEC.org on 18-Nov-2004

Benchmark run on Thu Oct 27 12:52:36 EDT 2005 by SPECmail2001 v1.01
Report generated on Thu Nov 18 11:27:34 EST 2004 by SPECmail2001 v1.05 HTML Formatter