SPECweb2005 Result: Hewlett-Packard: HP ProLiant DL380 G6

SPECweb2005 Result
Copyright © 2007 Standard Performance Evaluation Corporation

Hewlett-Packard: HP ProLiant DL380 G6
Accoria Networks, Inc.: Rock Web Server v1.4.7 (x86_64)
Accoria Networks, Inc.: Rock JSP/Servlet Container v1.3.2 (x86_64)

SPECweb2005 = 75023

SPECweb2005_Banking = 108096

SPECweb2005_Ecommerce = 132228

SPECweb2005_Support = 65472

Tested By: Hewlett-Packard

SPEC License #: 3

Test Date: Apr-2009

Performance and Configuration Section
Performance Section
Configuration Section
Common Workload Notes

Details Section
Banking Details
Ecommerce Details
Support Details

Notes Section
Banking Notes
Ecommerce Notes
Support Notes

Errors Section
Banking Errors
Ecommerce Errors
Support Errors

Performance

Banking

Simultaneous
User Sessions

Test
Iteration

Aggregate QOS Compliance

Good	Tolerable	Fail

Validation Errors

108096

95.3%

99.8%

0.2%

95.9%

99.8%

0.2%

95.4%

99.7%

0.3%

Ecommerce

Simultaneous
User Sessions

Test
Iteration

Aggregate QOS Compliance

Good	Tolerable	Fail

Validation Errors

132228

99.3%

100.0%

0.0%

99.1%

100.0%

0.0%

99.1%

100.0%

0.0%

Support

Simultaneous
User Sessions

Test
Iteration

Aggregate QOS Compliance

Good	Tolerable	Fail

Validation Errors

65472

96.5%

99.1%

0.9%

96.4%

99.1%

0.9%

96.5%

99.1%

0.9%

Configuration

Availability Dates
SUT Hardware	Mar-2009
Backend Simulator	Jul-2005
Web Server Software	May-2008 (Rock Web 1.4.7) May-2008 (Rock JSP 1.3.2)
Operating System	Jan-2009
Other Components	Apr-2009 (JVM)

System Under Test (SUT)

# of SUTs 1

Vendor Hewlett-Packard

Model HP ProLiant DL380 G6

Processor Intel Xeon Processor X5570

Processor Speed (MHz) 2933

# Processors 8 cores, 2 chips, 4 cores/chip (Hyper-Threading enabled)

Primary Cache 32KB(I) + 32KB(D) on chip, per core

Secondary Cache 256KB I+D on chip per chip

Other Cache 8MB I+D on chip per chip.

Memory 96GB (12x8GB PC3-10600R DDR3)

Disk Subsystem 2x36GB SFF SAS 15K RPM, 52x72GB SFF SAS 15K RPM

Disk Controllers Smart Array P410i (embedded), Smart Array P411 Controller with 512MB cache

Operating System RedHat Enterprise Linux 5.3 (2.6.18-128.el5)

File System ext2

Other Hardware 2x Modular Smart Array 70 Enclosure, 2xHP ProCurve Switch 3400cl-48G (J4906A), 2xHP Procurve Media Flex Module (J8435A), 4x HP Procurve SR Transceiver (J8436A)

Other Software Java(TM) SE Runtime Environment (build 1.6.0_13-b03), Java HotSpot(TM) 64-Bit Server VM (build 11.3-b02, mixed mode)

SUT Network

# of Controllers 6

Network Controllers 2x Intel Dual Port 10 Gigabit XF SR Server Adapters (EXPX9502AFXSR), 2x Intel Single Port 10 Gigabit XF SR Server Adapters (EXPX9501AFXSR), 2xNC382i (embedded dual port)

# of Networks 7

Network Type 10 Gigabit + 1 Gigabit Ethernet

Network Speed 10 Gb/s

MSL (sec) 30 (Non RFC1122)

Time-Wait (sec) 60 (Non RFC1122)

MTU Size 1500

Web Server Software
Vendor	Accoria Networks, Inc.
Name/Version	Rock Web Server v1.4.7 (x86_64)
Dynamic Scripts	JSP
Server Cache	N/A
Log Mode	Binary Common Log Format

JSP Script Engine

Vendor Accoria Networks, Inc.

Name/Version Rock JSP/Servlet Container v1.3.2 (x86_64)

Dynamic Scripts JSP

Server Cache N/A

Log Mode Binary Common Log Format

Clients

# of Clients 64

Model HP ProLiant DL360 G3

Processor Intel Xeon

Processor Speed (MHz) 3060

# Processors 2

Memory 4GB

Network Controller NC7170 (embedded)

Operating System Windows Server 2003 SP1

JVM Version Java 2 Runtime Environment, Standard Edition (build 1.5.0_06-b06)

JIT Version Java HotSpot Client VM (build 1.5.0_06-b05, mixed mode, sharing)

Other Hardware HP ProCurve 2848 for client management

Other Software N/A

Backend Simulator (BESIM)

# of Simulators 3

Model HP ProLiant DL385

Processor AMD Opteron 275

Processor Speed (MHz) 2200

# of Processors 2

Memory 4x2048MB PC3200 CL3.0

Network Controller HP NC7781 PCI-X Gigabit embedded

Operating System RHEL 4 U4 (kernel 2.6.9-42.ELsmp)

File System ext2

Web Server Accoria Rock Web Server 1.4.0 (x86_64)

Server Scripts ISAPI

Other Hardware N/A

Other Software N/A

Common Workload Notes

SUT Notes

1xSmart Array P411 with 512MB cache
2xModular Smart Array 70 Enclosures, one connected to each port on SmartArray P411
2 disk RAID 1 for OS Drive (36GB internal), 2 disk RAID 0 (72GB internal) for Log files, 50 disk for fileset
Disk Partitions were as follows for fileset: Banking: 1.5GB RAID0, Ecommerce: 450GB RAID0, Support: 1.5TB RAID0.
File system mounting options for fileset and log: nodiratime,noatime
4 client subnets connected through 3400cl switch (10GB), BeSims directly connected to SUT (1GB)
Second port on Dual Port 10GBe adapters not connected or configured.
Second port on embedded NIC 2 not connected or configured.
ROM Settings Changed from Default:
HP Power Profile: Maximum Performance, default Balanced Power and Performance
HP Power Regulator: HP Static High Performance Mode, default HP Dynamic Power Savings Mode
Memory Speed with 2 DIMMs per Channel: 1333MHz, default auto
CPU Characteristics: Intel Turbo Boost Technology up to 3.33 GHz

Operating System Notes

net.ipv4.conf.all.rp_filter = 1 #enables source route verification, default 0
net.ipv4.conf.all.arp_filter = 1 #tells the kernel whether the IP address should be bound to a specific ARP address, default 0
net.ipv4.tcp_timestamps = 0 #turns TCP timestamps off, default 1
net.ipv4.tcp_max_tw_buckets = 2000000, set TCP time-wait buckets pool size, default 180000
net.core.rmem_default = 67108864 #default receive socket buffer size, default 126976
net.core.rmem_max = 67108864 #maximum receive socket buffer size, default 131071
net.core.wmem_default = 67108864 #default send socket buffer size, default 126976
net.core.wmem_max = 67108864 #maximum send socket buffer size, default 131071
net.core.optmem_max = 67108864 #maximum amount of option memory buffers, default 20480
net.ipv4.tcp_rmem = 33554432 33554432 33554432 #maximum receive socket buffer size, default 4096 87380 4194304
net.ipv4.tcp_wmem = 33554432 33554432 33554432 #maximum TCP write-buffer space allocatable, default 4096 16384 4194304
net.ipv4.tcp_mem = 33554432 33554432 33554432 #maximum TCP buffer space allocatable, default 196608 262144 393216
net.ipv4.tcp_dsack = 0 #don't send duplicate SACK, default 1
net.ipv4.tcp_sack = 0 #turn off SACK option in the TCP option field in the TCP header when it sends out a SYN packet, default 1
net.ipv4.tcp_window_scaling = 0 #turns TCP window scaling support off, default 1
net.core.somaxconn = 640000 #size of listen que for accepting new TCP connections, default 128
net.core.netdev_max_backlog = 300000 #number of unprocessed input packets before kernel starts dropping them, default 1000
net.ipv4.tcp_max_syn_backlog = 200000, max number of remembered connection requests, default 1024
TSO enabled on client-data interfaces, default enabled
txqueuelen set to 160000 on all 10 GB NIC ports, 60000 on 1GB Besim NIC, default 1000
ulimit -n 1024000 #sets number of open files, default 1024
ulimit -u 1000000 #sets number of max user processes, default 131710
IXGBE driver version: 1.3.56.11-NAPI
ETH2 (besim1) NIC IRQ bound to cpu 4
ETH8 (besim2) NIC IRQ bound to cpu 5
ETH3 (besim3) NIC IRQ bound to cpu 6
CCISS0 (OS & Access Log) IRQ bound to cpu 4
CCISS1 (Data Set) IRQ bound to cpu 5

Web Server Software Notes

Common Web server configuration variables:
header_etag_on 0 #disables etag header in HTTP replies, default 1
header_server_on 0 #disables server ehader in HTTP replies, default 1
tcp_send_buf_size 1048576 #sets socket send buffer size
log_buf_size 1048576 #sets access log buffer size, default 65536
vailidate_httpmod -1 #disables HTTP module modification validation, default 0
keepalive_max 100000 #max keepalive requests on a connection, default 100
validate_static 604800 #static file modification validation, default 0
jrock_home /usr/local/jrock #Sets home path of Jrock JSP
server_log /weblog/httpd/httpd-1.log

HTTP Script Notes

SPEC-provided JSP scripts used without modification

Client Notes

TCP/IP registry tuning parameters [HKLMSystemCurrentControlSetServicesTcpipParameters]:
MaxHashTableSize=0x4000, sets TCB hash table size to 16384 entries, default is 512
TcpTimedWaitDelay=0x3c, sets TIME_WAIT parameter to 60 seconds (non-RFC 1122), default is 240
MaxFreeTwTcbs=400000, sets maximum number of TIME_WAIT tcbs to 400,000; default 1000
MaxFreeTcbs=0x16000, sets number of cached (pre-allocated) TCBs, default 1000
MaxUserPort=0xfffe, sets maximum open ports to 65534; default 5000
TcpWindowSize=65535, sets TCP send/receive window size, default 8192
NumTcbTablePartitions=32, sets number of independent TCB table segments, default 4
3 Client engines started per client system, Ports 1099,1100,1101
Client init string: java -Xms500m -Xmx500m -XX:+ForceTimeHighResolution -XX:+DisableExplicitGC -jar c:\progra~1\specweb2005\specwebclient.jar -lo c:\stdout-1xxx.txt -le c:\errorlog-1xxx.txt
Xms500m #Initial heap size set to 500MB
Xmx500m # Maximum heap size set to 500MB
XX:+ForceTimeHighResolution #Use high resulution timer, default not used
XX:+DisableExplicitGC #disable explicit GC calls, default enabled
jar c:\progra~1\specweb2005\specwebclient.jar #specify the jar file to run
lo c:\stdout-1xxx.txt #redirect stdout to log file name specified (default: primeclient.out)
le c:\errorlog-1xxx.txt #redirect errors to log file name specified (default: primeclient.err)

BESIM Notes

Web Server Configuration: 4 individual web server instances configured as below for port 81 thru 84. Replace xx below with port number.
user nobody #configures the user under which httpd runs
server_log /var/log/httpd/httpdxx.log #configures the location of the httpd server log file
validate_static 86400 #defines the modification checking interval for static pages
validate_httpmod -1 #disables HTTP module modification validation, default 0
header_etag_on 0 #disables etag header in HTTP replies, default 1
header_server_on 0 #disables server header in HTTP replies, default 1
accept_max 1 #maximum number of client connections httpd can accept at a time, default 50
log_buf_size 1048576 #sets access log buffer size, default 65536
tcp_send_buf_size 1048576 #sets socket send buffer size, default operating system default
keepalive_max 2000000 #max keepalive requests on a connection, default 100
connection_timeout 360000 #The number of connection reclaims because they time out, default 60
worker_count 4 #Starts 4 worker threads, default not used
connection_max 204800 #The maximum number of concurrent connections httpd is willing to handle, default=102400
host besim:xx
document_root /web
access_log /var/log/httpd/access_besimxx.log
error_log /var/log/httpd/error_besimxx.log
access_log_format commonlog
file /isapi-bin
cgi_type isapi
cgi_where internal
/file
/host
BESIM OS Configuration
ifconfig eth0 txqueuelen 60000
ulimit -n 1024000 #sets number of open files, default 1024
net.ipv4.ip_forward = 0 #Turns off IP packet forwarding, default off (0)
net.ipv4.conf.default.rp_filter = 1 # Controls source route verification, default 1
net.ipv4.icmp_echo_ignore_broadcasts = 1 #To enable protection against ICMP ECHO requests, default 0
net.ipv4.conf.all.arp_filter = 1 #instructs the kernel whether the IP address should be bound to a specific ARP address, default
net.ipv4.tcp_timestamps = 0 #Turn off the tcp_timestamps, default 1
net.core.rmem_max = 300000000 #maximum receive socket buffer size, default 65535
net.core.wmem_max = 300000000 #maximum send socket buffer size, default 65535
net.core.optmem_max = 10000000 #default 10240
net.core.netdev_max_backlog = 300000 #number of unprocessed input packets before kernel starts dropping them, default 300
net.ipv4.tcp_rmem = 30000000 30000000 30000000 #maximum TCP write-buffer space allocatable, default 4096 16384 131072
net.ipv4.tcp_wmem = 30000000 30000000 30000000 #maximum TCP write-buffer space allocatable, default 4096 16384 131072
net.ipv4.tcp_mem = 30000000 30000000 30000000 #maximum TCP buffer space allocatable, default 31744 32256 32768
net.ipv4.tcp_max_syn_backlog = 3000 #max number of remembered connection requests, default 1024
net.core.somaxconn = 140960 #size of listen que for accepting new TCP connections, default 128
Besim ISAPI compile instructions see HP-20061009.txt

Banking Run Details

Test results for each iteration

Iteration

Request Type

Total Reqs

QOS

Good	Tolerable	Fail

Weighted
ABR

Avg Resp
Time (sec)

Average
Bytes/Req

5841927

5590553

245432

5942

7,556.2

1.106

34903

account_summary

4113146

3904736

194145

14265

4,302.0

1.060

28224

check_detail_html

2303729

2126549

167157

10023

2,117.1

1.179

24798

bill_pay

3751779

3563595

175381

12803

3,636.5

1.051

26156

add_payee

300454

287118

12345

991

301.0

1.018

27032

payee_info

216137

202517

12861

759

357.3

1.168

44610

quick_pay

1800845

1664378

128826

7641

2,268.8

1.193

33997

billpay_status

599228

570979

26200

2049

750.5

1.052

33798

chg_profile

328753

310556

16959

1238

535.0

1.133

43910

post_profile

236441

226226

9458

757

327.0

1.044

37321

req_checks

329303

250797

76095

2411

1,085.0

1.752

88913

post_chk_order

236938

225485

10628

825

297.2

1.053

33853

req_xfer_form

467266

446911

18970

1385

393.3

1.008

22713

post_fund_xfer

336588

321137

14298

1153

314.1

1.018

25185

logout

1667651

1583689

79122

4840

4,676.2

1.276

75668

check_image

4609362

4596981

11988

393

1,815.8

0.384

10630

Total

27139547

25872207	1199865	67475

30,733.0

0.994

30,557

5874104

5644524

225133

4447

7,745.8

1.087

34922

account_summary

4137034

3952728

172397

11909

4,411.3

1.026

28238

check_detail_html

2317108

2161035

147374

8699

2,169.7

1.139

24798

bill_pay

3772241

3605963

155511

10767

3,725.6

1.017

26155

add_payee

301765

289745

11217

803

308.0

0.987

27031

payee_info

217135

205314

11133

688

365.8

1.130

44610

quick_pay

1811127

1690312

114403

6412

2,325.0

1.154

33997

billpay_status

602241

576923

23581

1737

768.6

1.019

33798

chg_profile

330784

314724

15048

1012

548.5

1.099

43910

post_profile

237830

228556

8623

651

335.2

1.015

37321

req_checks

330979

259884

69011

2084

1,111.4

1.712

88927

post_chk_order

238205

228118

9399

688

304.5

1.021

33852

req_xfer_form

469595

451519

16886

1190

403.0

0.977

22727

post_fund_xfer

338097

324436

12715

946

321.5

0.986

25185

logout

1677489

1602013

71431

4045

4,793.4

1.259

75675

check_image

4636226

4623850

12138

238

1,861.1

0.387

10631

Total

27291960

26159644	1076000	56316

31,498.2

0.970

30,564

5854605

5610153

238330

6122

7,589.7

1.098

34903

account_summary

4122465

3915832

188718

17915

4,321.8

1.054

28226

check_detail_html

2308994

2135808

160487

12699

2,126.6

1.170

24798

bill_pay

3759517

3571494

171706

16317

3,652.1

1.045

26155

add_payee

301211

287433

12425

1353

302.4

1.015

27030

payee_info

216675

203317

12256

1102

359.0

1.160

44610

quick_pay

1804877

1670558

124728

9591

2,279.0

1.186

33997

billpay_status

600352

571862

25847

2643

753.6

1.046

33796

chg_profile

329683

311599

16538

1546

537.7

1.127

43910

post_profile

237052

226575

9435

1042

328.6

1.041

37321

req_checks

329961

253558

73410

2993

1,089.6

1.746

88913

post_chk_order

237313

225897

10344

1072

298.4

1.050

33852

req_xfer_form

468508

448075

18606

1827

395.2

1.004

22712

post_fund_xfer

337406

321904

14036

1466

315.6

1.014

25185

logout

1671096

1586414

78328

6354

4,696.9

1.277

75675

check_image

4619781

4604765

14221

795

1,824.0

0.387

10630

Total

27199496

25945244	1169415	84837

30,870.3

0.989

30,557

Notes for Banking Workload

Operating System Notes

vm.nr_hugepages = 12500 #sets up huge pages
ETH0 (data) NIC IRQ bound to cpu 15
ETH1 (data) NIC IRQ bound to cpu 14
ETH4 (data) NIC IRQ bound to cpu 15
ETH5 (data) NIC IRQ bound to cpu 14
options ixgbe (10GB nic):
InterruptThrottleRate=10000,10000,10000,10000,1000,1000 # default 8000 on each ixgbe port
RSS=3,3,3,3,3,3 #default 1 on all ixgbe ports

Web Server Software Notes

2 web server instances started.
Banking Web Server 1 specific configuration variables:
cache_replacement random #random cache management, default lru
cache_memory_size 1 #sets memory manager size# default half system memory
jrock_config specweb2005.xml #Sets config file for Jrock JSP
servlet_session_count 204800 #configures the maximum number of concurrent user sessions at any time, default 23191
connection_max 1536000 #The maximum number of concurrent connections httpd is willing to handle, default=102400
disk_worker_count 128 #number of threads to read data from disk for large files, default 21
host server:443
address 131.100.100.160 131.101.100.160 #bind web server's listener socket specified IP address(es)
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key (RSA 1024Bit length)
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer (created via admin http)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access-1.log
access_log_format commonlog_binary
error_log /weblog/httpd/error-1.log
file /bankjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8080
Banking Web Server 2 specific configuration variables:
server_log /weblog/httpd/httpd-2.log
cache_replacement random #random cache management, default lru
cache_memory_size 1 #sets memory manager size# default half system memory
jrock_config specweb2005-2.xml #Sets config file for Jrock JSP
servlet_session_count 204800 #configures the maximum number of concurrent user sessions at any time, default 23191
connection_max 1536000 #The maximum number of concurrent connections httpd is willing to handle, default=102400
disk_worker_count 128 #number of threads to read data from disk for large files, default 21
host server:443
address 131.102.100.160 131.103.100.160 #bind web server's listener socket specified IP address(es)
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key (RSA 1024Bit length)
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer (created via admin http)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access-2.log
access_log_format commonlog_binary
error_log /weblog/httpd/error-2.log
file /bankjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8081
host server:449
address 131.100.100.160 #bind web server's listener socket specified IP address(es)
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key (RSA 1024Bit length)
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer (created via admin http)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access3.log
access_log_format commonlog_binary
error_log /weblog/httpd/error3.log
file /bankjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8081
Http service started with taskset command. Server 1 locked on Odd CPUs, Server2 locked on Even CPUs.

Other Notes

CHECK_IMAGE_SUBDIRS = 256, default 0

Errors for Banking Workload

Quality of Service Errors

No QOS Errors Found

Validation Errors

No Validation Errors Found

Ecommerce Run Details

Test results for each iteration

Iteration

Request Type

Total Reqs

QOS

Good	Tolerable	Fail

Weighted
ABR

Avg Resp
Time (sec)

Average
Bytes/Req

index

2875076

2866170

8377

529

11,145.5

1.605

138781

1435814

1422801

12945

9,031.1

2.329

225179

browse

2578549

2559300

18436

813

12,345.2

1.912

171397

browse_productline

2198403

2136707

61466

230

15,212.4

2.595

247728

productdetail

1758799

1751168

7216

415

2,636.4

1.210

53664

customize1

3716194

3710159

5937

17,156.3

1.740

165275

customize2

1968027

1964866

3104

9,045.1

1.735

164538

customize3

1353026

1329086

22692

1248

6,687.7

1.986

176952

cart

1164509

1160993

3306

210

2,389.4

0.883

73456

829309

828554

737

1,118.0

0.576

48264

shipping

779954

779572

373

936.6

0.509

42992

billing

740792

740040

725

683.6

0.476

33035

confirm

555627

555402

216

493.4

0.442

31790

Total

21954079

21804818	145530	3731

88,880.8

1.630

144,935

index

2871168

2858224

11979

965

11,084.3

1.613

138782

1435242

1418193

16927

122

8,990.1

2.334

225177

browse

2574696

2549054

24153

1489

12,275.8

1.922

171399

browse_productline

2195421

2124250

70705

466

15,129.3

2.601

247732

productdetail

1756815

1746079

9798

938

2,623.9

1.222

53691

customize1

3713162

3703076

9857

229

17,071.4

1.746

165275

customize2

1966772

1961432

5218

122

9,002.0

1.741

164539

customize3

1351864

1322412

27257

2195

6,654.3

2.003

176952

cart

1163543

1159050

4133

360

2,380.4

0.889

73544

828277

827213

1008

1,111.1

0.586

48222

shipping

779319

778658

619

932.0

0.519

42992

billing

739973

738711

1166

680.0

0.487

33035

confirm

554992

554613

354

490.8

0.449

31790

Total

21931244

21740965	183174	7105

88,425.5

1.639

144,942

index

2871738

2858644

12243

851

11,069.8

1.614

138780

1436493

1418501

17901

8,984.6

2.337

225178

browse

2575366

2549036

24845

1485

12,260.5

1.925

171396

browse_productline

2196424

2120177

75831

416

15,113.5

2.604

247732

productdetail

1756740

1745541

10475

724

2,620.0

1.225

53693

customize1

3712376

3702346

9845

185

17,042.3

1.748

165275

customize2

1966059

1960880

5085

8,985.3

1.743

164539

customize3

1351437

1321689

27774

1974

6,642.4

2.004

176955

cart

1163420

1158663

4413

344

2,375.1

0.891

73498

828252

827288

951

1,109.6

0.588

48233

shipping

779359

778736

621

930.7

0.523

42992

billing

739936

738666

1195

679.0

0.492

33036

confirm

554827

554482

324

489.9

0.451

31790

Total

21932427

21734649	191503	6275

88,302.6

1.641

144,950

Notes for Ecommerce Workload

Operating System Notes

vm.nr_hugepages = 16600 #sets up huge pages
echo 200 > /proc/irq/84/smp_affinity # bind eth0 Rx 0 irq to processor 9
echo 200 > /proc/irq/92/smp_affinity # bind eth0 Rx 1 irq to processor 9
echo 02 > /proc/irq/100/smp_affinity # bind eth0 Rx 2 irq to processor 1
echo 02 > /proc/irq/108/smp_affinity # bind eth0 Tx 0 irq to processor 1
echo 400 > /proc/irq/131/smp_affinity # bind eth1 Rx 0 irq to processor 10
echo 400 > /proc/irq/139/smp_affinity # bind eth1 Rx 1 irq to processor 10
echo 04 > /proc/irq/147/smp_affinity # bind eth1 Rx 2 irq to processor 2
echo 04 > /proc/irq/155/smp_affinity # bind eth1 Tx 0 irq to processor 2
echo 800 > /proc/irq/234/smp_affinity # bind eth4 Rx 0 irq to processor 11
echo 800 > /proc/irq/51/smp_affinity # bind eth4 Rx 1 irq to processor 11
echo 08 > /proc/irq/59/smp_affinity # bind eth4 Rx 2 irq to processor 3
echo 08 > /proc/irq/67/smp_affinity # bind eth4 Tx 0 irq to processor 3
echo 100 > /proc/irq/179/smp_affinity # bind eth0 Rx 0 irq to processor 8
echo 100 > /proc/irq/187/smp_affinity # bind eth0 Rx 1 irq to processor 8
echo 01 > /proc/irq/195/smp_affinity # bind eth0 Rx 2 irq to processor 0
echo 01 > /proc/irq/203/smp_affinity # bind eth0 Tx 0 irq to processor 0
options ixgbe (10GB nic):
RSS=3,3,3,3,3,3 #default 1 on all ixgbe ports

Web Server Software Notes

4 web server instances started.
Ecommerce Web Server 1 specific configuration variables:
jrock_config specweb2005.xml #Sets config file for Jrock JSP
cache_memory_size 4096 #cache manager memory, default half system memory
direct_io 1 #uses direct IO when possible
fast_read 1 #improve IO performance, default disabled
connection_timeout 300 #connection inactivity timeout, default 60
disk_worker_count 64 #number of threads to read data from disk for large files, default 21
host server:80
address 131.100.100.160 #bind web server's listener socket specified IP address(es)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access80-1.log
access_log_format commonlog_binary
error_log /weblog/httpd/error80-1.log
file /ecommjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8080
host server:443
address 131.100.100.160 #bind web server's listener socket specified IP address(es)
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key (RSA 1024Bit length)
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer (created via admin http)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access443-1.log
access_log_format commonlog_binary
error_log /weblog/httpd/error443-1.log
file /ecommjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8080
Ecommerce Web Server 2 specific configuration variables:
server_log /weblog/httpd/httpd-2.log
jrock_config specweb2005-2.xml #Sets config file for Jrock JSP
cache_memory_size 4096 #cache manager memory, default half system memory
direct_io 1 #cache manager memory, default half system memory
fast_read 1 #uses direct IO when possible
connection_timeout 300 #connection inactivity timeout, default 60
disk_worker_count 64 #number of threads to read data from disk for large files, default 21
host server:80
address 131.101.100.160 #bind web server's listener socket specified IP address(es)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access80-2.log
access_log_format commonlog_binary
error_log /weblog/httpd/error80-2.log
file /ecommjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8081
host server:443
address 131.101.100.160 #bind web server's listener socket specified IP address(es)
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key (RSA 1024Bit length)
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer (created via admin http)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access443-2.log
access_log_format commonlog_binary
error_log /weblog/httpd/error443-2.log
file /ecommjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8081
host server:449
address 131.100.100.160
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access449.log
access_log_format commonlog_binary
error_log /weblog/httpd/error449.log
file /ecommjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8081
Ecommerce Web Server 3 specific configuration variables:
server_log /weblog/httpd/httpd-3.log
jrock_config specweb2005-3.xml #Sets config file for Jrock JSP
cache_memory_size 4096 #cache manager memory, default half system memory
direct_io 1 #cache manager memory, default half system memory
fast_read 1 #uses direct IO when possible
connection_timeout 300 #connection inactivity timeout, default 60
disk_worker_count 64 #number of threads to read data from disk for large files, default 21
host server:80
address 131.102.100.160 #bind web server's listener socket specified IP address(es)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access80-3.log
access_log_format commonlog_binary
error_log /weblog/httpd/error80-3.log
file /ecommjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8082
host server:443
address 131.102.100.160 #bind web server's listener socket specified IP address(es)
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key (RSA 1024Bit length)
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer (created via admin http)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access443-3.log
access_log_format commonlog_binary
error_log /weblog/httpd/error443-3.log
file /ecommjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8082
host server:450
address 131.100.100.160
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access450.log
access_log_format commonlog_binary
error_log /weblog/httpd/error450.log
file /ecommjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8082
Ecommerce Web Server 4 specific configuration variables:
server_log /weblog/httpd/httpd-4.log
jrock_config specweb2005-4.xml #Sets config file for Jrock JSP
cache_memory_size 4096 #cache manager memory, default half system memory
direct_io 1 #cache manager memory, default half system memory
fast_read 1 #uses direct IO when possible
connection_timeout 300 #connection inactivity timeout, default 60
disk_worker_count 64 #number of threads to read data from disk for large files, default 21
host server:80
address 131.103.100.160 #bind web server's listener socket specified IP address(es)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access80-4.log
access_log_format commonlog_binary
error_log /weblog/httpd/error80-4.log
file /ecommjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8083
host server:443
address 131.103.100.160 #bind web server's listener socket specified IP address(es)
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key (RSA 1024Bit length)
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer (created via admin http)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access443-4.log
access_log_format commonlog_binary
error_log /weblog/httpd/error443-4.log
file /bankjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8083
host server:451
address 131.100.100.160
ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key
ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access451.log
access_log_format commonlog_binary
error_log /weblog/httpd/error451.log
file /ecommjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8083
Http service started with taskset command.
Server 1 locked on CPUs 0,4,8,12, Server2 locked on CPUs 1,5,9,13
Server 3 locked on CPUs 2,6,10,14, Server4 locked on CPUs 3,7,11,15

JSP Script Engine Notes

JAVA_OPTS=-Xms8g -Xmx8g -XX:+UseParallelOldGC -XX:+DisableExplicitGC -XX:+AggressiveOpts -XX:+UseLargePages -d64 -server
Xms8g # Initial heap size set to 8GB, default 4MB
Xmx8g # Maximum heap size set to 8GB, default 4MB
XX:+UseParallelOldGC #Use parallel garbage collection for the full collections, default not used
XX:+AggressiveOpts #Turns on point performance optimizations, default not used
XX:+UseLargePages #Turns on Large Pages, default not enabled
XX:+DisableExplicitGC #disable explicit GC calls, default enabled
d64 #if available, a 64-bit data model is used, default not used
server #uses optimizing JIT compiler, default not used
4 JRock instance to deploy JSP scripts on listener port 8080,8081,8082,8083.
JRock configuration file (specweb2005.xml,specweb2005-2.xml,specweb2005-3.xml,specweb2005-4.xml)
server_log /weblog/jrock/server-x.log
listener xxxx # port to listen for requests
keepalive_max 0 #max number keepalive requests (0 = unlimited), default 100
connection_timeout 0 #time a connector will wait to be present (0 = unlimited), default 60sec
docroot /web/ecommerce
context_path /ecommjsp
session_timeout 300

Other Notes

LG_BUFF_SIZE=90112, default 22528
PRODUCT_IMAGE_SUBDIRS = 256, default 10

Errors for Ecommerce Workload

Quality of Service Errors

No QOS Errors Found

Validation Errors

No Validation Errors Found

Support Run Details

Test results for each iteration

Iteration

Request Type

Total Reqs

QOS

Good	Tolerable	Fail

Weighted
ABR

Avg Resp
Time (sec)

Average
Bytes/Req

home

898021

877734

18763

1524

837.0

1.038

62026

1395056

1394936

579.6

0.552

27649

catalog

1297726

1297525

147

718.9

0.635

36865

product

2742393

2717081

25178

134

2,817.7

1.403

68379

fileCatalog

2492179

2375243

116098

838

4,122.7

1.807

110095

file

1494439

1383635

109873

931

2,821.5

1.978

125649

download

748602

633390

20000

95212

78,557.5

70.416

6983904

Total

11068416

10679544	290155	98717

90,454.8

6.012

543,885

home

897835

876606

19618

1611

836.0

1.041

62026

1394561

1394453

578.8

0.552

27649

catalog

1297162

1296949

151

717.8

0.636

36864

product

2741791

2717125

24557

109

2,814.3

1.404

68379

fileCatalog

2491617

2374008

116788

821

4,117.9

1.809

110096

file

1494140

1380496

112673

971

2,818.2

1.980

125650

download

748424

629934

19695

98795

78,485.7

70.504

6985939

Total

11065530

10669571	293572	102387

90,368.8

6.020

544,036

home

899348

878563

19206

1579

838.0

1.037

62025

1397097

1396975

580.3

0.551

27650

catalog

1299430

1299214

152

719.6

0.634

36864

product

2746141

2721395

24612

134

2,821.0

1.400

68380

fileCatalog

2495521

2380077

114597

847

4,127.4

1.804

110096

file

1496436

1387487

107953

996

2,824.7

1.975

125650

download

749648

636932

19556

93160

78,584.7

70.345

6978062

Total

11083621

10700643	286171	96807

90,495.8

6.005

543,501

Notes for Support Workload

Operating System Notes

vm.nr_hugepages = 4200 #sets up huge pages
echo 200 > /proc/irq/84/smp_affinity # bind eth0 Rx 0 irq to processor 9
echo 200 > /proc/irq/92/smp_affinity # bind eth0 Rx 1 irq to processor 9
echo 02 > /proc/irq/100/smp_affinity # bind eth0 Rx 2 irq to processor 1
echo 02 > /proc/irq/108/smp_affinity # bind eth0 Tx 0 irq to processor 1
echo 400 > /proc/irq/131/smp_affinity # bind eth1 Rx 0 irq to processor 10
echo 400 > /proc/irq/139/smp_affinity # bind eth1 Rx 1 irq to processor 10
echo 04 > /proc/irq/147/smp_affinity # bind eth1 Rx 2 irq to processor 2
echo 04 > /proc/irq/155/smp_affinity # bind eth1 Tx 0 irq to processor 2
echo 800 > /proc/irq/234/smp_affinity # bind eth4 Rx 0 irq to processor 11
echo 800 > /proc/irq/51/smp_affinity # bind eth4 Rx 1 irq to processor 11
echo 08 > /proc/irq/59/smp_affinity # bind eth4 Rx 2 irq to processor 3
echo 08 > /proc/irq/67/smp_affinity # bind eth4 Tx 0 irq to processor 3
echo 100 > /proc/irq/179/smp_affinity # bind eth0 Rx 0 irq to processor 8
echo 100 > /proc/irq/187/smp_affinity # bind eth0 Rx 1 irq to processor 8
echo 01 > /proc/irq/195/smp_affinity # bind eth0 Rx 2 irq to processor 0
echo 01 > /proc/irq/203/smp_affinity # bind eth0 Tx 0 irq to processor 0
options ixgbe (10GB nic):
RSS=3,3,3,3,3,3 #default 1 on all ixgbe ports
options ixgbe (10GB nic):
RSS=3,3,3,3,3,3 #default 1 on all ixgbe ports

Web Server Software Notes

2 web server instances started.
Support Web Server 1 specific configuration variables:
jrock_config specweb2005.xml #Sets config file for Jrock JSP
direct_io 1 #uses direct IO when possible
cache_memory_size 16384 #cache manager memory, default half system memory
fast_read 1 #improve IO performance, default disabled
disk_worker_count 128 #number of disk workers, default 24
connection_timeout 600 #connection inactivity timeout, default 60
host server:80
address 131.100.100.160 131.101.100.160 #bind web server's listener socket specified IP address(es)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access80-1.log
access_log_format commonlog_binary
error_log /weblog/httpd/error80-1.log
file /suppjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8080
Support Web Server 2 specific configuration variables:
server_log /weblog/httpd/httpd-2.log
jrock_config specweb2005-2.xml #Sets config file for Jrock JSP
direct_io 1 #uses direct IO when possible
cache_memory_size 16384 #cache manager memory, default half system memory
fast_read 1 #improve IO performance, default disabled
disk_worker_count 128 #number of disk workers, default 24
connection_timeout 600 #connection inactivity timeout, default 60
host server:80
address 131.102.100.160 131.103.100.160 #bind web server's listener socket specified IP address(es)
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access80-2.log
access_log_format commonlog_binary
error_log /weblog/httpd/error80-2.log
file /suppjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8081
host server:88
address 131.102.100.160 131.103.100.160
default_mime_type text/html
document_root /web
access_log /weblog/httpd/access80-3.log
access_log_format commonlog_binary
error_log /weblog/httpd/error80-3.log
file /suppjsp
cgi_type internal_java
cgi_regex .*jsp
cgi_listener 127.0.0.1/8081
Http service started with taskset command. Server 1 locked on Odd CPUs, Server2 locked on Even CPUs.

JSP Script Engine Notes

JAVA_OPTS=-Xms4g -Xmx4g -XX:+UseParallelOldGC -XX:+DisableExplicitGC -XX:+AggressiveOpts -XX:+UseLargePages -d64 -server
Xms4g # Initial heap size set to 4GB, default 4MB
Xmx4g # Maximum heap size set to 4GB, default 4MB
XX:+UseParallelOldGC #Use parallel garbage collection for the full collections, default not used
XX:+AggressiveOpts #Turns on point performance optimizations, default not used
XX:+DisableExplicitGC #disable explicit GC calls, default enabled
XX:+UseLargePages #Turns on Large Pages, default not enabled
d64 #if available, a 64-bit data model is used, default not used
server #uses optimizing JIT compiler, default not used
2 JRock instance to deploy JSP scripts on listener port 8080,8081.
JRock configuration file (specweb2005.xml)
server_log /weblog/jrock/server.log
listener 8080 # port to listen for requests
keepalive_max 0 #max number keepalive requests (0 = unlimited), default 100
connection_timeout 0 #time a connector will wait to be present (0 = unlimited), default 60sec
docroot /web/support
context_path /suppjsp
session_count 1
session_timeout 3600
JRock configuration file (specweb2005-2.xml)
server_log /weblog/jrock/server-2.log
listener 8081 # port to listen for requests
keepalive_max 0 #max number keepalive requests (0 = unlimited), default 100
connection_timeout 0 #time a connector will wait to be present (0 = unlimited), default 60sec
docroot /web/support
context_path /suppjsp
session_count 1
session_timeout 3600

Other Notes

Errors for Support Workload

Quality of Service Errors

No QOS Errors Found

Validation Errors

No Validation Errors Found

For questions about this result, please contact the submitter: Hewlett-Packard

First published at SPEC.org on 07-May-2009