SPECmail2001 Result Copyright © 1999-2001 Standard Performance Evaluation Corporation |
SPECmail2001 on Sun Fire V1280 with Sun[TM] ONE Messaging server 5.2 | SPECmail2001 msgs/min = 5,005 |
SPEC license # 6 | Tested by: Sun Microsystems, Inc. |
Test date: Apr-2003 |
Hardware Avail: Mar-2003 |
Software Avail: Dec-2002 |
5,005 SPECmail2001 messages per minute is equivalent to 1,001,000 SPECmail2001_users.
Detail Summary |
General Notes
System configurations: SMTP Server + POP server + LDAP server | Benchmark Manager/Load Generator | Load Generator | SMTP SINK | Configuration diagram Detailed results: Detailed Results 80% load | Detailed Results 100% load | Detailed Results 120% load |
Summary Results |
||||||
---|---|---|---|---|---|---|
Function | Response time limit (seconds) |
Required Percentage Compliant |
Percentage Compliant | |||
80% | 100% | 120% | ||||
SMTP Connect | 5 | >95% | 100.00% | 100.00% | 100.00% | |
SMTP Data | 5 | >95% | 100.00% | 100.00% | 99.89% | |
POP Connect | 5 | >95% | 100.00% | 100.00% | 100.00% | |
POP Status | 5 | >95% | 100.00% | 100.00% | 100.00% | |
POP Retrieve | 5 | >95% | 100.00% | 100.00% | 100.00% | |
POP Delete | 5 | >95% | 100.00% | 100.00% | 100.00% | |
Delivery Time | 60 | >95% | 99.06% | 98.84% | 38.57% | |
Error Rate | NA | <1% | 0.00% | 0.00% | 0.00% |
SMTP Server + POP server + LDAP server (1 system) | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||
|
Benchmark Manager/Load Generator (1 system) | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||
|
Load Generator (1 system) | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||
|
SMTP SINK (2 systems) | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||
|
Detailed Results -- 80% Load |
|||
---|---|---|---|
Load | User Count | Message Rate (msg/min) |
|
Attempted | 800,800 | 4,004 | |
Actual | 801,400 | 4,007 | |
Function | Attempts | # Pass QoS |
% Pass QoS |
SMTP Connect | 456,193 | 456,193 | 100.00% |
SMTP Hello | 456,193 | 456,193 | 100.00% |
SMTP Mail From | 456,192 | 456,192 | 100.00% |
SMTP Rcpt To | 914,886 | 914,886 | 100.00% |
SMTP Data | 456,193 | 456,193 | 100.00% |
SMTP Quit | 451,764 | 451,764 | 100.00% |
POP Connect | 481,421 | 481,421 | 100.00% |
POP User ID | 481,417 | 481,417 | 100.00% |
POP Password | 481,414 | 481,414 | 100.00% |
POP Status | 481,415 | 481,415 | 100.00% |
POP Retrieve | 481,823 | 481,823 | 100.00% |
POP Delete | 480,533 | 480,533 | 100.00% |
POP Quit | 480,142 | 480,142 | 100.00% |
Delivery Time | 4,471 | 4,429 | 99.06% |
SMTP Data Response Time | 456,193 | 451,766 | 99.03% |
POP Retrieve Response Time | 481,823 | 481,152 | 99.86% |
Remote Message Delivery | 434,343 | 429,916 | 98.98% |
Counter |
Value |
||
SMTP Connect Error | 0 | ||
SMTP Protocol Error | 0 | ||
SMTP Disconnect | 4,427 | ||
SMTP Session | 451,764 | ||
SMTP To Local | 480,538 | ||
SMTP To Remote | 434,343 | ||
SINK Connect Error | 0 | ||
POP Connect Error | 0 | ||
POP Protocol Error | 0 | ||
POP Disconnect | 1,291 | ||
POP Session | 480,142 | ||
Delivery Time Connect Error | 0 | ||
Function | Minimum Time (millisec) |
Maximum Time (millisec) |
Average Time (millisec) |
SMTP Connect | 2 | 740 | 13.77 |
SMTP Hello | 1 | 749 | 25.93 |
SMTP Mail From | 0 | 700 | 13.38 |
SMTP Rcpt To | 0 | 738 | 17.71 |
SMTP Data | 0 | 1,940 | 42.55 |
SMTP Quit | 0 | 680 | 13.20 |
POP Connect | 1 | 3,389 | 22.89 |
POP User ID | 0 | 737 | 45.93 |
POP Password | 1 | 2,780 | 41.66 |
POP Status | 0 | 721 | 24.39 |
POP Retrieve | 0 | 2,880 | 35.25 |
POP Delete | 0 | 691 | 24.42 |
POP Quit | 0 | 2,407 | 32.15 |
Function | Minimum Size (KB) |
Maximum Size (KB) |
Average Size (KB) |
SMTP Data (KB up) | 1 | 2,674 | 24.26 |
POP Retrieve (KB down) | 1 | 2,675 | 24.40 |
Detailed Results -- 100% Load |
|||
---|---|---|---|
Load | User Count | Message Rate (msg/min) |
|
Attempted | 1,001,000 | 5,005 | |
Actual | 1,001,200 | 5,006 | |
Function | Attempts | # Pass QoS |
% Pass QoS |
SMTP Connect | 569,927 | 569,927 | 100.00% |
SMTP Hello | 569,926 | 569,926 | 100.00% |
SMTP Mail From | 569,928 | 569,928 | 100.00% |
SMTP Rcpt To | 1,134,542 | 1,134,542 | 100.00% |
SMTP Data | 569,936 | 569,936 | 100.00% |
SMTP Quit | 564,283 | 564,283 | 100.00% |
POP Connect | 601,523 | 601,523 | 100.00% |
POP User ID | 601,527 | 601,527 | 100.00% |
POP Password | 601,529 | 601,529 | 100.00% |
POP Status | 601,536 | 601,536 | 100.00% |
POP Retrieve | 601,836 | 601,836 | 100.00% |
POP Delete | 600,218 | 600,218 | 100.00% |
POP Quit | 599,980 | 599,980 | 100.00% |
Delivery Time | 5,674 | 5,608 | 98.84% |
SMTP Data Response Time | 569,936 | 564,283 | 99.01% |
POP Retrieve Response Time | 601,836 | 600,995 | 99.86% |
Remote Message Delivery | 536,480 | 532,147 | 99.19% |
Counter |
Value |
||
SMTP Connect Error | 0 | ||
SMTP Protocol Error | 0 | ||
SMTP Disconnect | 5,653 | ||
SMTP Session | 564,283 | ||
SMTP To Local | 598,059 | ||
SMTP To Remote | 536,480 | ||
SINK Connect Error | 0 | ||
POP Connect Error | 0 | ||
POP Protocol Error | 0 | ||
POP Disconnect | 1,614 | ||
POP Session | 599,980 | ||
Delivery Time Connect Error | 0 | ||
Function | Minimum Time (millisec) |
Maximum Time (millisec) |
Average Time (millisec) |
SMTP Connect | 2 | 611 | 15.35 |
SMTP Hello | 0 | 359 | 27.75 |
SMTP Mail From | 0 | 395 | 13.48 |
SMTP Rcpt To | 0 | 429 | 19.62 |
SMTP Data | 0 | 3,022 | 49.53 |
SMTP Quit | 0 | 442 | 13.55 |
POP Connect | 1 | 486 | 23.46 |
POP User ID | 0 | 680 | 46.79 |
POP Password | 1 | 2,810 | 47.71 |
POP Status | 0 | 500 | 24.63 |
POP Retrieve | 0 | 2,870 | 36.82 |
POP Delete | 0 | 503 | 24.65 |
POP Quit | 0 | 3,018 | 33.91 |
Function | Minimum Size (KB) |
Maximum Size (KB) |
Average Size (KB) |
SMTP Data (KB up) | 1 | 2,674 | 24.52 |
POP Retrieve (KB down) | 1 | 2,675 | 24.65 |
Detailed Results -- 120% Load |
|||
---|---|---|---|
Load | User Count | Message Rate (msg/min) |
|
Attempted | 1,201,200 | 6,006 | |
Actual | 1,201,000 | 6,005 | |
Function | Attempts | # Pass QoS |
% Pass QoS |
SMTP Connect | 684,769 | 684,769 | 100.00% |
SMTP Hello | 684,763 | 684,763 | 100.00% |
SMTP Mail From | 684,759 | 684,759 | 100.00% |
SMTP Rcpt To | 1,369,834 | 1,369,834 | 100.00% |
SMTP Data | 684,674 | 683,930 | 99.89% |
SMTP Quit | 677,867 | 677,867 | 100.00% |
POP Connect | 720,479 | 720,479 | 100.00% |
POP User ID | 720,484 | 720,484 | 100.00% |
POP Password | 720,498 | 715,708 | 99.34% |
POP Status | 720,487 | 720,487 | 100.00% |
POP Retrieve | 710,483 | 710,483 | 100.00% |
POP Delete | 708,629 | 708,629 | 100.00% |
POP Quit | 718,738 | 718,734 | 100.00% |
Delivery Time | 6,946 | 2,679 | 38.57% |
SMTP Data Response Time | 684,674 | 677,850 | 99.00% |
POP Retrieve Response Time | 710,483 | 709,508 | 99.86% |
Remote Message Delivery | 649,911 | 414,119 | 63.72% |
Counter |
Value |
||
SMTP Connect Error | 0 | ||
SMTP Protocol Error | 0 | ||
SMTP Disconnect | 6,819 | ||
SMTP Session | 677,867 | ||
SMTP To Local | 719,928 | ||
SMTP To Remote | 649,911 | ||
SINK Connect Error | 0 | ||
POP Connect Error | 0 | ||
POP Protocol Error | 0 | ||
POP Disconnect | 1,850 | ||
POP Session | 718,738 | ||
Delivery Time Connect Error | 0 | ||
Function | Minimum Time (millisec) |
Maximum Time (millisec) |
Average Time (millisec) |
SMTP Connect | 2 | 3,409 | 273.14 |
SMTP Hello | 1 | 3,188 | 288.77 |
SMTP Mail From | 0 | 909 | 16.26 |
SMTP Rcpt To | 0 | 2,001 | 120.67 |
SMTP Data | 0 | 14,962 | 577.97 |
SMTP Quit | 0 | 882 | 16.91 |
POP Connect | 1 | 1,334 | 60.31 |
POP User ID | 0 | 1,565 | 102.96 |
POP Password | 1 | 28,965 | 614.51 |
POP Status | 0 | 1,360 | 67.95 |
POP Retrieve | 1 | 2,242 | 52.89 |
POP Delete | 0 | 1,331 | 58.27 |
POP Quit | 0 | 5,250 | 87.87 |
Function | Minimum Size (KB) |
Maximum Size (KB) |
Average Size (KB) |
SMTP Data (KB up) | 1 | 2,674 | 24.43 |
POP Retrieve (KB down) | 1 | 2,675 | 24.52 |
General Notes / Tuning Information |
---|
Network Connectivity: 1 Sun Gigabit Ethernet conection from the Mail server to 1 Cisco 49126 Gigabit Switch Each client and the mail sinks has 1 Sun Gigabit Ethernet connection to the same Cisco 49126 Gigabit Switch |
First published at SPEC.org on 07-May-2003
Benchmark run on Mon Apr 14 09:26:22 EDT 2003 by SPECmail2001 v1.01