SPECweb2005 Result: Hewlett-Packard: HP ProLiant DL580 G5

SPECweb2005 Result
Copyright © 2007 Standard Performance Evaluation Corporation

Hewlett-Packard: HP ProLiant DL580 G5
Accoria Networks, Inc.: Rock Web Server v1.4.7 (x86_64)
Accoria Networks, Inc.: Rock JSP/Servlet Container v1.3.2 (x86_64)

SPECweb2005 = 50013

SPECweb2005_Banking = 97632

SPECweb2005_Ecommerce = 69600

SPECweb2005_Support = 40800

Tested By: Hewlett-Packard

SPEC License #: 3

Test Date: Jan-2009

Performance and Configuration Section
Performance Section
Configuration Section
Common Workload Notes

Details Section
Banking Details
Ecommerce Details
Support Details

Notes Section
Banking Notes
Ecommerce Notes
Support Notes

Errors Section
Banking Errors
Ecommerce Errors
Support Errors

Performance

Banking

Simultaneous
User Sessions

Test
Iteration

Aggregate QOS Compliance

Good	Tolerable	Fail

Validation Errors

97632

96.4%

99.9%

0.1%

96.4%

99.9%

0.1%

96.5%

99.9%

0.1%

Ecommerce

Simultaneous
User Sessions

Test
Iteration

Aggregate QOS Compliance

Good	Tolerable	Fail

Validation Errors

69600

96.2%

99.9%

0.1%

97.1%

100.0%

0.0%

96.8%

100.0%

0.0%

Support

Simultaneous
User Sessions

Test
Iteration

Aggregate QOS Compliance

Good	Tolerable	Fail

Validation Errors

40800

95.8%

99.9%

0.1%

96.2%

99.9%

0.1%

95.4%

99.9%

0.1%

Configuration

Availability Dates
SUT Hardware	Sep-2008
Backend Simulator	Jul-2005
Web Server Software	May-2008 (Rock Web 1.4.7) May-2008 (Rock JSP 1.3.2)
Operating System	Sep-2008
Other Components	Jul-2008 (JVM)

System Under Test (SUT)

# of SUTs 1

Vendor Hewlett-Packard

Model HP ProLiant DL580 G5

Processor Intel Xeon X7460 Processor

Processor Speed (MHz) 2667

# Processors 24 cores, 4 chips, 6 cores/chip

Primary Cache 32KB(I) + 32KB(D) on chip, per core

Secondary Cache 9 MB I+D on chip per chip, 3 MB shared / 2 cores

Other Cache 16 MB I+D on chip per chip

Memory 128GB (16x8GB) 667MHz ECC CL5 DDR2 FB-DIMM

Disk Subsystem 6x72GB SFF SAS 15K RPM, 100x36GB SFF SAS 15K RPM

Disk Controllers Smart Array P400i Controller with 512MB cache, 2x Smart Array E500 Controller with 256MB cache

Operating System RedHat Enterprise Linux 5.2 (2.6.18-92.e15)

File System ext2

Other Hardware 4x Modular Smart Array 70 Enclosure, 1xHP ProCurve Switch 5406zl (J8697A), 2xProCurve Switch zl 4-Port 10-GbE X2 Module (J8707A), 4xProCurve 10-GbE X2-SC SR Optic (J8436A)

Other Software Java(TM) SE Runtime Environment (build 1.6.0_07-b06), Java HotSpot(TM) 64-Bit Server VM (build 10.0-b23, mixed mode)

SUT Network

# of Controllers 3

Network Controllers 2x Dual Port 10 Gigabit XF SR Server Adapters (EXPX9502AFXSR), 1xNC371i Multifunction Gigabit Network Adapters (embedded)

# of Networks 5

Network Type 10 Gigabit & 1 Gigabit Ethernet

Network Speed 10 Gb/s

MSL (sec) 30 (Non RFC1122)

Time-Wait (sec) 60 (Non RFC1122)

MTU Size 1500

Web Server Software
Vendor	Accoria Networks, Inc.
Name/Version	Rock Web Server v1.4.7 (x86_64)
Dynamic Scripts	JSP
Server Cache	N/A
Log Mode	Binary Common Log Format

JSP Script Engine

Vendor Accoria Networks, Inc.

Name/Version Rock JSP/Servlet Container v1.3.2 (x86_64)

Dynamic Scripts JSP

Server Cache N/A

Log Mode Binary Common Log Format

Clients

# of Clients 32

Model HP ProLiant DL360 G3

Processor Intel Xeon

Processor Speed (MHz) 3200

# Processors 2

Memory 4GB

Network Controller NC7170 (embedded)

Operating System Windows Server 2003 SP1

JVM Version Java 2 Runtime Environment, Standard Edition (build 1.5.0_06-b06)

JIT Version Java HotSpot Client VM (build 1.5.0_06-b05, mixed mode, sharing)

Other Hardware N/A

Other Software N/A

Backend Simulator (BESIM)

# of Simulators 1

Model HP ProLiant DL385

Processor AMD Opteron 275

Processor Speed (MHz) 2200

# of Processors 2

Memory 4x2048MB PC3200 CL3.0

Network Controller HP NC7781 PCI-X Gigabit embedded

Operating System RHEL 4 U4 (kernel 2.6.9-42.ELsmp)

File System ext2

Web Server Accoria Rock Web Server 1.4.0 (x86_64)

Server Scripts ISAPI

Other Hardware N/A

Other Software N/A

Common Workload Notes

SUT Notes

2xSmart Array E500 with 256MB cache
4xModular Smart Array 70 Enclosures, one connected to each port on SmartArray E500
2 drive RAID 0 for OS Drive (internal), 4 drives RAID 0 for access log (internal)
3 Logical Drives configured per port on each E500 for a total of 6 logical drives. Each Logical drive spread across all 25 drives in each MSA-70 enclosure).
Partition 1: 512GB RAID 0
Partition 2: 127GB RAID 0
Partition 3: 248GB RAID 0
Software RAID configured as RAID 0 across partitions on each E500 Port creating the following data drives:
Banking: 1.9TB
Ecommerce: 481GB
Support: 933GB
4 client subnets connected through HP 5406zl Switch
BeSim directly connected to SUT on embedded NIC
ROM Settings:
Power Regulator for Proliant: Static High Performance, default=OS Control Mode

Operating System Notes

net.ipv4.conf.all.rp_filter = 1 #enables source route verification, default 0
net.ipv4.conf.all.arp_filter = 1 #indicates to the the kernel whether the IP address should be bound to a specific ARP address, default 0
net.ipv4.tcp_timestamps = 0 #turns TCP timestamps off, default 1
net.ipv4.tcp_max_tw_buckets = 4000000 #set TCP time-wait buckets pool size, default 180000
net.core.rmem_max = 67108864 #maximum receive socket buffer size, default 135168
net.core.wmem_max = 67108864 #maximum send socket buffer size, default 135168
net.core.optmem_max = 67108864 #maximum amount of option memory buffers, default 20480
net.ipv4.tcp_rmem = 4096 16777216 67108864 #maximum TCP read-buffer space allocatable, default 4096 87380 174760
net.ipv4.tcp_wmem = 4096 16777216 67108864 #maximum TCP write-buffer space allocatable, default 4096 16384 131072
net.ipv4.tcp_mem = 67108864 67108864 67108864 #maximum TCP buffer space allocatable, default 786432 1048576 1572864
net.ipv4.tcp_dsack = 0 #turns DSACK support off, default on
net.ipv4.tcp_sack = 0 #turns SACK support off, default on
net.ipv4.tcp_window_scaling = 0 #turns TCP window scaling support off, default on
net.core.somaxconn = 640000 #size of listen que for accepting new TCP connections, default 128
net.core.netdev_max_backlog = 250000 #number of unprocessed input packets before kernel starts dropping them, default 300
net.ipv4.tcp_max_syn_backlog = 200000 #max number of remembered connection requests, default 1024

HTTP Script Notes

SPEC-provided JSP scripts used without modification

Client Notes

TCP/IP registry tuning parameters [HKLMSystemCurrentControlSetServicesTcpipParameters]:
TcpTimedWaitDelay=0x3c, sets TIME_WAIT parameter to 60 seconds (non-RFC 1122), default is 240
MaxFreeTwTcbs=400000, sets maximum number of TIME_WAIT tcbs to 400,000
TcpWindowSize=65535, sets TCP send/receive window size, default 8192
Client init string: java -cp c:/program files/specweb2005 -Xms500m -Xmx500m -XX:+ForceTimeHighResolution -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -jar c:/program files/specweb2005/specwebclient.jar -lo c:/stdout-1xxx.txt -le c:/errorlog-1xxx.txt
-cp c:/program files/specweb2005 #class search path of directories and zip/jar files
-Xms500m #Initial heap size set to 500MB, default 4MB
-Xmx500m # Maximum heap size set to 500MB, default 4MB
-XX:+ForceTimeHighResolution #Use high resulution timer, default not used
-XX:+UseParNewGC #use optimize garbage collection for applications, default not used
-XX:+UseConcMarkSweepGC #Selects the parallel garbage collector for the new generation of the Java heap, default not used
-jar c:/program files/specweb2005/specwebclient.jar #specify the jar file to run
-lo c:/stdout-1xxx.txt #redirect stdout to log file name specified (default: primeclient.out)
-le c:/errorlog-1xxx.txt #redirect errors to log file name specified (default: primeclient.err)

BESIM Notes

Web Server Configuration: 4 individual web server instances configured as below for port 81 thru 84. Replace xx below with port number.
user nobody #configures the user under which httpd runs
server_log /var/log/httpd/httpdxx.log #configures the location of the httpd server log file
validate_static 86400 #defines the modification checking interval for static pages
validate_httpmod -1 #disables HTTP module modification validation, default 0
header_etag_on 0 #disables etag header in HTTP replies, default 1
header_server_on 0 #disables server header in HTTP replies, default 1
log_buf_size 1048576 #sets access log buffer size, default 65536
tcp_send_buf_size 1048576 #sets socket send buffer size, default operating system default
keepalive_max 2000000 #max keepalive requests on a connection, default 100
connection_timeout 360000 #The number of connection reclaims because they time out, default 60
worker_count 4 #Starts 4 worker threads, default not used
host besim:xx
document_root /web
access_log /var/log/httpd/access_besim.log
error_log /var/log/httpd/error_besim.log
access_log_format commonlog
file /isapi-bin
cgi_type isapi
cgi_where internal
/file
/host
BESIM OS Configuration
ifconfig eth0 txqueuelen 60000
ulimit -n 1024000 #sets number of open files, default 1024
net.ipv4.conf.all.arp_filter = 1 #instructs the kernel whether the IP address should be bound to a specific ARP address, default
net.ipv4.icmp_echo_ignore_broadcasts = 1 #To enable protection against ICMP ECHO requests, default 0
net.ipv4.tcp_timestamps = 0 #Turn off the tcp_timestamps, default 1
net.ipv4.tcp_max_tw_buckets = 30000000 #Set TCP time-wait buckets pool size, default 180000
net.core.rmem_max = 30000000 #maximum receive socket buffer size, default 65535
net.core.rmem_default = 30000000 #default receive socket buffer size, default 65535
net.core.wmem_max = 30000000 #maximum send socket buffer size, default 65535
net.core.optmem_max = 30000000 #default 10240
net.core.netdev_max_backlog = 3000000 #number of unprocessed input packets before kernel starts dropping them, default 300
net.ipv4.tcp_rmem = 30000000 30000000 30000000 #maximum TCP write-buffer space allocatable, default 4096 16384 131072
net.ipv4.tcp_wmem = 30000000 30000000 30000000 #maximum TCP write-buffer space allocatable, default 4096 16384 131072
net.ipv4.tcp_mem = 30000000 30000000 30000000 ##maximum TCP buffer space allocatable, default 31744 32256 32768
net.ipv4.tcp_max_syn_backlog = 400000 #max number of remembered connection requests, default 1024
net.core.somaxconn = 140960 #size of listen que for accepting new TCP connections, default 128
Besim ISAPI compile instructions see HP-20061009.txt

Banking Run Details

Test results for each iteration

Iteration

Request Type

Total Reqs

QOS

Good	Tolerable	Fail

Weighted
ABR

Avg Resp
Time (sec)

Average
Bytes/Req

5076530

4805160

248838

22532

5,852.4

1.589

34910

account_summary

3572549

3541362

31022

165

3,329.9

1.399

28225

check_detail_html

2000497

1795584

204665

248

1,638.2

1.695

24798

bill_pay

3258086

3230245

27686

155

2,814.0

1.394

26155

add_payee

260520

259152

1359

232.6

1.325

27033

payee_info

187438

181029

6395

276.1

1.613

44610

quick_pay

1564027

1456754

107097

176

1,755.9

1.665

33997

billpay_status

520250

516937

3290

580.5

1.370

33792

chg_profile

285798

281643

4142

414.4

1.513

43911

post_profile

205680

204733

944

253.5

1.327

37322

req_checks

285662

104021

181542

838.7

2.070

88912

post_chk_order

205504

204227

1268

229.7

1.371

33852

req_xfer_form

406611

404553

2048

305.0

1.306

22712

post_fund_xfer

292894

291407

1482

243.6

1.312

25184

logout

1449329

1444082

5220

3,621.7

1.359

75673

check_image

4004450

4004407

1,405.5

0.212

10629

Total

23575825

22725296	827041	23488

23,791.7

1.284

30,559

5070096

4789466

256970

23660

5,815.8

1.600

34908

account_summary

3569614

3545277

24215

122

3,310.9

1.407

28226

check_detail_html

1998654

1784806

213658

190

1,628.7

1.706

24798

bill_pay

3254724

3232832

21796

2,797.4

1.402

26155

add_payee

260727

259681

1042

231.6

1.333

27032

payee_info

187626

181713

5906

275.1

1.620

44612

quick_pay

1562022

1453430

108470

122

1,745.0

1.674

33997

billpay_status

519406

516858

2535

576.8

1.376

33793

chg_profile

285718

282230

3481

412.3

1.520

43910

post_profile

205590

204863

719

252.1

1.332

37321

req_checks

285495

97317

188119

834.1

2.076

88912

post_chk_order

205424

204463

954

228.5

1.378

33854

req_xfer_form

405906

404272

1626

302.9

1.315

22712

post_fund_xfer

292426

291265

1157

242.0

1.321

25185

logout

1448137

1443761

4354

3,601.0

1.363

75672

check_image

4000775

4000750

1,397.3

0.213

10628

Total

23552340

22692984	835027	24329

23,651.6

1.292

30,559

5077610

4810064

242660

24886

5,868.6

1.586

34908

account_summary

3574820

3548822

25752

246

3,340.7

1.394

28225

check_detail_html

2001741

1797333

204072

336

1,643.5

1.688

24798

bill_pay

3259681

3236638

22805

238

2,822.9

1.389

26155

add_payee

260711

259529

1169

233.4

1.321

27033

payee_info

187604

181672

5912

277.1

1.608

44611

quick_pay

1564717

1459886

104617

214

1,761.3

1.658

33997

billpay_status

520780

517988

2770

582.7

1.365

33793

chg_profile

285895

282457

3422

415.7

1.508

43911

post_profile

205699

204873

820

254.2

1.323

37321

req_checks

285641

106823

178701

117

840.9

2.064

88911

post_chk_order

205477

204410

1056

230.3

1.366

33853

req_xfer_form

406619

404919

1675

305.8

1.302

22712

post_fund_xfer

292869

291578

1281

244.2

1.308

25183

logout

1450016

1445048

4920

3,633.1

1.356

75675

check_image

4006618

4006565

1,410.0

0.211

10629

Total

23586498

22758605	801683	26210

23,864.2

1.280

30,558

Notes for Banking Workload

Operating System Notes

kernel.shmall = 68719476736 #sets the total amount of shared memory pages that can be used system wide
vm.nr_hugepages = 12600 #sets up huge pages
echo 01 > /proc/irq/172/smp_affinity #bind eth0 irq to processor 0 (besim)
echo 10 > /proc/irq/76/smp_affinity #bind eth1 RX1 irq to processor 4
echo 1000 > /proc/irq/84/smp_affinity #bind eth1 RX2 irq to processor 12
echo 100000 > /proc/irq/92/smp_affinity #bind eth1 RX3 irq to processor 20
echo 100 > /proc/irq/100/smp_affinity #bind eth1 RX4 irq to processor 8
echo 10000 > /proc/irq/108/smp_affinity #bind eth1 TX1 eth1 irq to processor 16
echo 02 > /proc/irq/124/smp_affinity #bind eth2 RX1 irq to processor 1
echo 200 > /proc/irq/132/smp_affinity #bind eth2 RX2 irq to processor 9
echo 20000 > /proc/irq/140/smp_affinity #bind eth2 RX3 irq to processor 17
echo 20 > /proc/irq/148/smp_affinity #bind eth2 RX4 irq to processor 5
echo 2000 > /proc/irq/156/smp_affinity #bind eth2 TX1 irq to processor 13
echo 04 > /proc/irq/171/smp_affinity #bind eth3 RX1 irq to processor 2
echo 400 > /proc/irq/179/smp_affinity #bind eth3 RX2 irq to processor 10
echo 40000 > /proc/irq/187/smp_affinity #bind eth3 RX3 irq to processor 18
echo 40 > /proc/irq/195/smp_affinity #bind eth3 RX4 irq to processor 6
echo 4000 > /proc/irq/203/smp_affinity #bind eth3 TX1 irq to processor 14
echo 08 > /proc/irq/219/smp_affinity #bind eth4 RX1 irq to processor 3
echo 800 > /proc/irq/227/smp_affinity #bind eth4 RX2 irq to processor 11
echo 80000 > /proc/irq/235/smp_affinity #bind eth4 RX3 irq to processor 19
echo 80 > /proc/irq/52/smp_affinity #bind eth4 RX4 irq to processor 7
echo 8000 > /proc/irq/60/smp_affinity #bind eth4 TX1 irq to processor 15
echo 800000 > /proc/irq/107/smp_affinity #bind C2 to processor 23 (OS)
echo 8000 > /proc/irq/139/smp_affinity #bind C1 to processor 15 (DATA)
echo 4000 > /proc/irq/91/smp_affinity #bind C0 to processor 14 (DATA)
txqueuelen set to 160000 on all 10GB NIC ports, 60000 on 1GB NIC ports #default 1000
ulimit -n 1024000 #sets number of open files, default 1024
ulimit -u 1000000 #sets number of max user processes, default 131710
options ixgbe options ixgbe RSS=4,4,4,4 InterruptThrottleRate=5000,5000,5000,5000

Web Server Software Notes

2 Web servers, configration as follows:
Web Server 1:
server_log /weblog/httpd/httpd.log
header_etag_on 0 #disables etag header in HTTP replies, default 1
header_server_on 0 #disables server ehader in HTTP replies, default 1
tcp_send_buf_size 1048576 #sets socket send buffer size
log_buf_size 1048576 #sets access log buffer size, default 65536
vailidate_httpmod -1 #disables HTTP module modification validation, default 0
keepalive_max 100000 #max keepalive requests on a connection, default 100
validate_static 604800 #static file modification validation, default 0
jrock_home /usr/local/jrock #Sets home path of Jrock JSP
jrock_config specweb2005.xml #Sets config file for Jrock JSP
connection_timeout 600 #connection inactivity timeout, default 60
cache_replacement random #random cache management, default lru
disk_worker_count 256 #number of threads to read data from disk for large files, default 21
connection_max 204800 #The maximum number of concurrent connections httpd is willing to handle, default=102400
worker 131.100.100.160/443
worker 131.100.100.160/443
worker 131.100.100.160/443
worker 131.100.100.160/443
worker 131.100.100.160/443
worker 131.100.100.160/443
worker 131.100.100.160/443
worker 131.100.100.160/443
worker 131.101.100.160/443
worker 131.101.100.160/443
worker 131.101.100.160/443
worker 131.101.100.160/443
worker 131.101.100.160/443
worker 131.101.100.160/443
worker 131.101.100.160/443
worker 131.101.100.160/443
host server:443
address 131.100.100.160 131.101.100.160 # allows you to bind web server's listener socket to one or more concrete IP address.
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key (RSA 1024Bit length)
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer (created via admin http)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access.log
access_log_format commonlog_binary
error_log /weblog/httpd/error.log
ssl_session_max 96000 #maximum number of concurrent SSL sessions, default 39751
ssl_session_timeout 900 #SSL session timeout value in seconds, default 1 day
file /bankjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8080
/file
/host
Web Server 2:
server_log /weblog/httpd/httpd2.log
header_etag_on 0 #disables etag header in HTTP replies, default 1
header_server_on 0 #disables server ehader in HTTP replies, default 1
tcp_send_buf_size 1048576 #sets socket send buffer size
log_buf_size 1048576 #sets access log buffer size, default 65536
vailidate_httpmod -1 #disables HTTP module modification validation, default 0
keepalive_max 100000 #max keepalive requests on a connection, default 100
validate_static 604800 #static file modification validation, default 0
jrock_home /usr/local/jrock #Sets home path of Jrock JSP
jrock_config specweb2005-2.xml #Sets config file for Jrock JSP
connection_timeout 600 #connection inactivity timeout, default 60
cache_replacement random #random cache management, default lru
disk_worker_count 256 #number of threads to read data from disk for large files, default 21
connection_max 204800 #The maximum number of concurrent connections httpd is willing to handle, default=102400
worker 131.102.100.160/443
worker 131.102.100.160/443
worker 131.102.100.160/443
worker 131.102.100.160/443
worker 131.102.100.160/443
worker 131.102.100.160/443
worker 131.102.100.160/443
worker 131.102.100.160/443
worker 131.103.100.160/443
worker 131.103.100.160/443
worker 131.103.100.160/443
worker 131.103.100.160/443
worker 131.103.100.160/443
worker 131.103.100.160/443
worker 131.103.100.160/443
worker 131.103.100.160/443
worker 131.100.100.160/449
host server:443
address 131.102.100.160 131.103.100.160 # allows you to bind web server's listener socket to one or more concrete IP address.
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key (RSA 1024Bit length)
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer (created via admin http)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access2.log
access_log_format commonlog_binary
error_log /weblog/httpd/error2.log
ssl_session_max 96000 #maximum number of concurrent SSL sessions, default 39751
ssl_session_timeout 900 #SSL session timeout value in seconds, default 1 day
file /bankjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8081
/file
/host
host server:449
address 131.100.100.160 # allows you to bind web server's listener socket to one or more concrete IP address.
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key (RSA 1024Bit length)
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer (created via admin http)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access3.log
access_log_format commonlog_binary
error_log /weblog/httpd/error3.log
file /bankjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8081
/file
/host

JSP Script Engine Notes

JAVA_OPTS=-Xms8g -Xmx8g -XX:+UseParallelGC -XX:+DisableExplicitGC -XX:+UseLargePages -XX:+AggressiveOpts -XX:ParallelGCThreads=8 -d64 -server
Xms8g # Initial heap size set to 8GB
Xmx8g # Maximum heap size set to 8GB
XX:+AggressiveOpts #Turns on point performance optimizations, default not used
XX:+DisableExplicitGC #disable explicit GC calls, default enabled
XX:+UseLargePages #Turns on Large Pages, default not enabled
XX:ParallelGCThreads=8 # number of garbage collector threads, default one per logical cpu
XX:+UseParallelGC #use optimize garbage collection for applications
d64 #if available, a 64-bit data model is used, default not used
server #uses optimizing JIT compiler, default not used
2 JRock instances to deploy JSP scripts on port 8080 & 8081
JRock configuration file (specweb2005.xml)
server_log /weblog/jrock/server.log
listener 8080 # port to listen for requests
keepalive_max 0 #max number keepalive requests (0 = unlimited), default 100
connection_timeout 0 #time a connector will wait to be present (0 = unlimited), default 60sec
docroot /web/bank
context_path /bankjsp
session_timeout 600
JRock configuration file (specweb2005-2.xml)
server_log /weblog/jrock/server2.log
listener 8081 # port to listen for requests
keepalive_max 0 #max number keepalive requests (0 = unlimited), default 100
connection_timeout 0 #time a connector will wait to be present (0 = unlimited), default 60sec
docroot /web/bank
context_path /bankjsp
session_timeout 600

Client Notes

3 Client engines started per client system

Other Notes

CHECK_IMAGE_SUBDIRS = 256

Errors for Banking Workload

Quality of Service Errors

No QOS Errors Found

Validation Errors

No Validation Errors Found

Ecommerce Run Details

Test results for each iteration

Iteration

Request Type

Total Reqs

QOS

Good	Tolerable	Fail

Weighted
ABR

Avg Resp
Time (sec)

Average
Bytes/Req

index

1491061

1442716

47494

851

10,245.9

1.895

139046

746858

718185

28671

7,800.0

2.304

211330

browse

1337032

1260114

76232

686

10,972.8

2.140

166066

browse_productline

1140352

1012629

127705

12,744.7

2.543

226150

productdetail

912123

906611

5419

2,425.6

1.334

53811

customize1

1926247

1910143

16092

15,745.7

1.872

165407

customize2

1019926

1011688

8232

8,299.7

1.866

164665

customize3

701077

607014

88195

5868

6,142.5

2.339

177290

cart

603563

588408

14621

534

2,198.5

1.122

73708

429945

421399

8098

448

1,026.9

0.682

48329

shipping

404396

404393

860.2

0.562

43044

billing

384038

383992

629.6

0.555

33173

confirm

287977

287967

454.4

0.507

31928

Total

11384595

10955259	420816	8518

79,546.7

1.777

141,386

index

1492665

1466189

26297

179

10,445.0

1.845

139050

748028

723898

24130

7,955.2

2.284

211329

browse

1338489

1285306

53087

11,185.2

2.094

166055

browse_productline

1141435

1024228

117206

12,990.4

2.525

226149

productdetail

913063

911342

1720

2,472.7

1.288

53814

customize1

1928162

1917432

10730

16,050.2

1.849

165410

customize2

1021272

1015664

5608

8,463.0

1.844

164666

customize3

701849

632939

67230

1680

6,261.8

2.252

177287

cart

604211

592795

11221

195

2,241.6

1.083

73720

430376

422985

7068

323

1,046.3

0.661

48310

shipping

404872

877.0

0.550

43044

billing

384625

384601

642.1

0.536

33172

confirm

287972

287971

462.7

0.495

31928

Total

11397019

11070222	324320	2475

81,093.2

1.743

141,389

index

1496983

1463064

33724

195

10,357.7

1.868

139053

750178

723642

26536

7,888.3

2.296

211329

browse

1342478

1278268

64116

11,092.5

2.117

166057

browse_productline

1144807

1021566

123240

12,882.1

2.536

226148

productdetail

915634

913543

2091

2,451.7

1.305

53812

customize1

1934140

1921172

12968

15,919.0

1.861

165411

customize2

1024217

1017370

6847

8,391.9

1.856

164667

customize3

704219

626538

75820

1861

6,212.3

2.279

177288

cart

606025

593558

12274

193

2,222.1

1.094

73689

431620

423707

7676

237

1,038.5

0.665

48357

shipping

405812

869.2

0.553

43044

billing

385447

385433

636.2

0.541

33173

confirm

288789

288784

458.8

0.497

31928

Total

11430349

11062457	365311	2581

80,420.2

1.758

141,397

Notes for Ecommerce Workload

Operating System Notes

echo 01 > /proc/irq/172/smp_affinity #bind eth0 irq to processor 0 (besim)
echo 10 > /proc/irq/76/smp_affinity #bind eth1 RX1 irq to processor 4
echo 1000 > /proc/irq/84/smp_affinity #bind eth1 RX2 irq to processor 12
echo 100000 > /proc/irq/92/smp_affinity #bind eth1 RX3 irq to processor 20
echo 100 > /proc/irq/100/smp_affinity #bind eth1 RX4 irq to processor 8
echo 10000 > /proc/irq/108/smp_affinity #bind eth1 TX1 eth1 irq to processor 16
echo 02 > /proc/irq/124/smp_affinity #bind eth2 RX1 irq to processor 1
echo 200 > /proc/irq/132/smp_affinity #bind eth2 RX2 irq to processor 9
echo 20000 > /proc/irq/140/smp_affinity #bind eth2 RX3 irq to processor 17
echo 20 > /proc/irq/148/smp_affinity #bind eth2 RX4 irq to processor 5
echo 2000 > /proc/irq/156/smp_affinity #bind eth2 TX1 irq to processor 13
echo 04 > /proc/irq/171/smp_affinity #bind eth3 RX1 irq to processor 2
echo 400 > /proc/irq/179/smp_affinity #bind eth3 RX2 irq to processor 10
echo 40000 > /proc/irq/187/smp_affinity #bind eth3 RX3 irq to processor 18
echo 40 > /proc/irq/195/smp_affinity #bind eth3 RX4 irq to processor 6
echo 4000 > /proc/irq/203/smp_affinity #bind eth3 TX1 irq to processor 14
echo 08 > /proc/irq/219/smp_affinity #bind eth4 RX1 irq to processor 3
echo 800 > /proc/irq/227/smp_affinity #bind eth4 RX2 irq to processor 11
echo 80000 > /proc/irq/235/smp_affinity #bind eth4 RX3 irq to processor 19
echo 80 > /proc/irq/52/smp_affinity #bind eth4 RX4 irq to processor 7
echo 8000 > /proc/irq/60/smp_affinity #bind eth4 TX1 irq to processor 15
echo 800000 > /proc/irq/107/smp_affinity #bind C2 to processor 23 (OS)
echo 8000 > /proc/irq/139/smp_affinity #bind C1 to processor 15 (DATA)
echo 4000 > /proc/irq/91/smp_affinity #bind C0 to processor 14 (DATA)
txqueuelen set to 160000 on all 10GB NIC ports, 60000 on 1GB NIC ports #default 1000
ulimit -n 1024000 #sets number of open files, default 1024
ulimit -u 1000000 #sets number of max user processes, default 131710
options ixgbe options ixgbe RSS=4,4,4,4 InterruptThrottleRate=5000,5000,5000,5000

Web Server Software Notes

2 Web servers, configration as follows:
Web Server 1:
server_log /weblog/httpd/httpd.log
header_etag_on 0 #disables etag header in HTTP replies, default 1
header_server_on 0 #disables server ehader in HTTP replies, default 1
tcp_send_buf_size 1048576 #sets socket send buffer size
log_buf_size 1048576 #sets access log buffer size, default 65536
vailidate_httpmod -1 #disables HTTP module modification validation, default 0
keepalive_max 100000 #max keepalive requests on a connection, default 100
validate_static 604800 #static file modification validation, default 0
jrock_home /usr/local/jrock #Sets home path of Jrock JSP
jrock_config specweb2005.xml #Sets config file for Jrock JSP
connection_timeout 9600 #connection inactivity timeout, default 60
cache_memory_size 12288 #cache manager memory, default half system memory
cache_replacement lru #random cache management, default lru
worker 131.100.100.160/80
worker 131.100.100.160/80
worker 131.100.100.160/80
worker 131.100.100.160/80
worker 131.100.100.160/80
worker 131.100.100.160/80
worker 131.100.100.160/80
worker 131.101.100.160/80
worker 131.101.100.160/80
worker 131.101.100.160/80
worker 131.101.100.160/80
worker 131.101.100.160/80
worker 131.101.100.160/80
worker 131.101.100.160/80
worker 131.100.100.160/443
worker 131.100.100.160/443
worker 131.101.100.160/443
worker 131.101.100.160/443
host server:80
address 131.100.100.160 131.101.100.160 # allows you to bind web server's listener socket to one or more concrete IP address.
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access80-1.log
access_log_format commonlog_binary
error_log /weblog/httpd/error80-1.log
/ecommjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8080
/file
/host
host server:443
address 131.100.100.160 131.101.100.160 # allows you to bind web server's listener socket to one or more concrete IP address.
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key (RSA 1024Bit length)
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer (created via admin http)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access.log
access_log_format commonlog_binary
error_log /weblog/httpd/error.log
ssl_session_max 96000 #maximum number of concurrent SSL sessions, default 39751
ssl_session_timeout 900 #SSL session timeout value in seconds, default 1 day
file /bankjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8080
/file
/host
Web Server 2:
server_log /weblog/httpd/httpd-2.log
header_etag_on 0 #disables etag header in HTTP replies, default 1
header_server_on 0 #disables server ehader in HTTP replies, default 1
tcp_send_buf_size 1048576 #sets socket send buffer size
log_buf_size 1048576 #sets access log buffer size, default 65536
vailidate_httpmod -1 #disables HTTP module modification validation, default 0
keepalive_max 100000 #max keepalive requests on a connection, default 100
validate_static 604800 #static file modification validation, default 0
jrock_home /usr/local/jrock #Sets home path of Jrock JSP
jrock_config specweb2005.xml #Sets config file for Jrock JSP
connection_timeout 9600 #connection inactivity timeout, default 60
cache_memory_size 12288 #cache manager memory, default half system memory
cache_replacement lru #random cache management, default lru
worker 131.102.100.160/80
worker 131.102.100.160/80
worker 131.102.100.160/80
worker 131.102.100.160/80
worker 131.102.100.160/80
worker 131.102.100.160/80
worker 131.102.100.160/80
worker 131.103.100.160/80
worker 131.103.100.160/80
worker 131.103.100.160/80
worker 131.103.100.160/80
worker 131.103.100.160/80
worker 131.103.100.160/80
worker 131.103.100.160/80
worker 131.102.100.160/443
worker 131.102.100.160/443
worker 131.103.100.160/443
worker 131.103.100.160/443
worker 131.100.100.160/449
host server:80
address 131.103.100.160 131.103.100.160 # allows you to bind web server's listener socket to one or more concrete IP address.
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access80-2.log
access_log_format commonlog_binary
error_log /weblog/httpd/error80-2.log
/ecommjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8080
/file
/host
host server:443
address 131.100.100.160 131.101.100.160 # allows you to bind web server's listener socket to one or more concrete IP address.
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key (RSA 1024Bit length)
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer (created via admin http)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access-2.log
access_log_format commonlog_binary
error_log /weblog/httpd/error-2.log
ssl_session_max 96000 #maximum number of concurrent SSL sessions, default 39751
ssl_session_timeout 900 #SSL session timeout value in seconds, default 1 day
file /bankjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8081
/file
/host
host server:449
address 131.100.100.160
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access443-3.log
access_log_format commonlog_binary
error_log /weblog/httpd/error443-3.log
/ecommjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8081
/file
/host

JSP Script Engine Notes

JAVA_OPTS=-Xms12g -Xmx12g -XX:+UseParallelGC -XX:+DisableExplicitGC -XX:+AggressiveOpts -XX:ParallelGCThreads=8 -d64 -server
Xms12g # Initial heap size set to 12GB
Xmx12g # Maximum heap size set to 12GB
XX:+AggressiveOpts #Turns on point performance optimizations, default not used
XX:+DisableExplicitGC #disable explicit GC calls, default enabled
-XX:ParallelGCThreads=8 # number of garbage collector threads, default one per logical cpu
XX:+UseParallelGC #use optimize garbage collection for applications
d64 #if available, a 64-bit data model is used, default not used
server #uses optimizing JIT compiler, default not used
2 JRock instances to deploy JSP scripts on port 8080 & 8081
JRock configuration file (specweb2005.xml)
server_log /weblog/jrock/server.log
listener 8080 # port to listen for requests
keepalive_max 0 #max number keepalive requests (0 = unlimited), default 100
connection_timeout 0 #time a connector will wait to be present (0 = unlimited), default 60sec
docroot /web/ecommerce
context_path /ecommjsp
session_timeout 600
JRock configuration file (specweb2005-2.xml)
server_log /weblog/jrock/server2.log
listener 8081 # port to listen for requests
keepalive_max 0 #max number keepalive requests (0 = unlimited), default 100
connection_timeout 0 #time a connector will wait to be present (0 = unlimited), default 60sec
docroot /web/ecommerce
context_path /ecommjsp
session_timeout 600

Client Notes

3 Client engines started per client system

Other Notes

LG_BUFF_SIZE=87112, default 22528
PRODUCT_IMAGE_SUBDIRS = 256, default 10

Errors for Ecommerce Workload

Quality of Service Errors

No QOS Errors Found

Validation Errors

2 Validation Errors for Iteration 1 : 130.168.87.23:1100 - shipping

2 Validation Errors for Iteration 2 : 130.168.87.26:1099 - billing

Support Run Details

Test results for each iteration

Iteration

Request Type

Total Reqs

QOS

Good	Tolerable	Fail

Weighted
ABR

Avg Resp
Time (sec)

Average
Bytes/Req

home

544272

543961

310

797.3

1.055

61629

845939

845936

556.0

0.779

27648

catalog

785641

673.9

0.812

36087

product

1661446

1590102

70238

1106

2,700.6

1.969

68381

fileCatalog

1511341

1401738

108204

1399

3,921.6

2.262

109159

file

907131

807781

98031

1319

2,701.0

2.423

125259

download

453577

450011

3446

120

74,419.4

69.023

6902388

Total

6709347

6425170	280232	3945

85,769.8

6.270

537,796

home

546397

546073

324

803.8

1.024

61630

849831

849819

560.9

0.749

27649

catalog

788888

788885

679.6

0.786

36088

product

1668317

1604742

62420

1155

2,723.1

1.898

68380

fileCatalog

1517644

1420265

95969

1410

3,954.4

2.199

109160

file

910939

823120

86346

1473

2,723.6

2.361

125260

download

455315

451382

3803

130

74,998.5

69.007

6900723

Total

6737331

6484286	248877	4168

86,443.9

6.218

537,526

home

543955

543650

304

797.2

1.056

61630

845955

845945

556.2

0.780

27649

catalog

785615

785614

674.2

0.811

36088

product

1660995

1581112

78635

1248

2,701.0

1.972

68380

fileCatalog

1510860

1391533

117783

1544

3,922.0

2.266

109159

file

906907

801807

103695

1405

2,701.4

2.426

125259

download

453347

449481

3727

139

74,381.4

68.993

6899377

Total

6707634

6399142	304155	4337

85,733.5

6.269

537,473

Notes for Support Workload

Operating System Notes

echo 01 > /proc/irq/172/smp_affinity #bind eth0 irq to processor 0 (besim)
echo 10 > /proc/irq/76/smp_affinity #bind eth1 RX1 irq to processor 4
echo 1000 > /proc/irq/84/smp_affinity #bind eth1 RX2 irq to processor 12
echo 100000 > /proc/irq/92/smp_affinity #bind eth1 RX3 irq to processor 20
echo 100 > /proc/irq/100/smp_affinity #bind eth1 RX4 irq to processor 8
echo 10000 > /proc/irq/108/smp_affinity #bind eth1 TX1 eth1 irq to processor 16
echo 02 > /proc/irq/124/smp_affinity #bind eth2 RX1 irq to processor 1
echo 200 > /proc/irq/132/smp_affinity #bind eth2 RX2 irq to processor 9
echo 20000 > /proc/irq/140/smp_affinity #bind eth2 RX3 irq to processor 17
echo 20 > /proc/irq/148/smp_affinity #bind eth2 RX4 irq to processor 5
echo 2000 > /proc/irq/156/smp_affinity #bind eth2 TX1 irq to processor 13
echo 04 > /proc/irq/171/smp_affinity #bind eth3 RX1 irq to processor 2
echo 400 > /proc/irq/179/smp_affinity #bind eth3 RX2 irq to processor 10
echo 40000 > /proc/irq/187/smp_affinity #bind eth3 RX3 irq to processor 18
echo 40 > /proc/irq/195/smp_affinity #bind eth3 RX4 irq to processor 6
echo 4000 > /proc/irq/203/smp_affinity #bind eth3 TX1 irq to processor 14
echo 08 > /proc/irq/219/smp_affinity #bind eth4 RX1 irq to processor 3
echo 800 > /proc/irq/227/smp_affinity #bind eth4 RX2 irq to processor 11
echo 80000 > /proc/irq/235/smp_affinity #bind eth4 RX3 irq to processor 19
echo 80 > /proc/irq/52/smp_affinity #bind eth4 RX4 irq to processor 7
echo 8000 > /proc/irq/60/smp_affinity #bind eth4 TX1 irq to processor 15
echo 800000 > /proc/irq/107/smp_affinity #bind C2 to processor 23 (OS)
echo 8000 > /proc/irq/139/smp_affinity #bind C1 to processor 15 (DATA)
echo 4000 > /proc/irq/91/smp_affinity #bind C0 to processor 14 (DATA)
txqueuelen set to 160000 on all 10GB NIC ports, 60000 on 1GB NIC ports #default 1000
ulimit -n 1024000 #sets number of open files, default 1024
ulimit -u 1000000 #sets number of max user processes, default 131710
options ixgbe options ixgbe RSS=4,4,4,4 InterruptThrottleRate=4000,4000,4000,4000

Web Server Software Notes

Web Server 1:
server_log /weblog/httpd/httpd.log
header_etag_on 0 #disables etag header in HTTP replies, default 1
header_server_on 0 #disables server ehader in HTTP replies, default 1
tcp_send_buf_size 1048576 #sets socket send buffer size
log_buf_size 1048576 #sets access log buffer size, default 65536
vailidate_httpmod -1 #disables HTTP module modification validation, default 0
keepalive_max 100000 #max keepalive requests on a connection, default 100
validate_static 604800 #static file modification validation, default 0
jrock_home /usr/local/jrock #Sets home path of Jrock JSP
jrock_config specweb2005.xml #Sets config file for Jrock JSP
connection_timeout 86400 #connection inactivity timeout, default 60
cache_replacement lru #random cache management, default lru
disk_worker_count 192 #number of threads to read data from disk for large files, default 21
direct_io 1 #uses direct IO when possible
cache_file_count 96000 #number of hash table buckets for the cache manager
cache_file_max_size 4194304 #The largest static file that can be cached in the cache manager, default 2097152
fast_read 1 #improve IO performance, default disabled
port_getn 512 #IO evente retrieve from the OS at one time, default 1
worker_count 16 #specifies the number of workers to start
host server:80
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access80.log
access_log_format commonlog_binary
error_log /weblog/httpd/error80.log
file /suppjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8080
/file
/host

JSP Script Engine Notes

JAVA_OPTS=-Xms4g -Xmx4g -XX:+UseParallelGC -d64 -server
Xms4g # Initial heap size set to 4GB
Xmx4g # Maximum heap size set to 4GB
XX:+UseParallelGC #use optimize garbage collection for applications
d64 #if available, a 64-bit data model is used, default not used
server #uses optimizing JIT compiler, default not used
1 JRock instance to deploy JSP scripts on port 8080
JRock configuration file (specweb2005.xml)
server_log /weblog/jrock/server.log
listener 8080 # port to listen for requests
keepalive_max 0 #max number keepalive requests (0 = unlimited), default 100
connection_timeout 0 #time a connector will wait to be present (0 = unlimited), default 60sec
docroot /web/support
context_path /suppjsp
session_count 1
session_timeout 3600

Client Notes

2 Client engines started per client system

Other Notes

Errors for Support Workload

Quality of Service Errors

No QOS Errors Found

Validation Errors

No Validation Errors Found

For questions about this result, please contact the submitter: Hewlett-Packard

First published at SPEC.org on 30-Jan-2009