SPECjAppServer2004 Result: WebSphere 6.0 Application Server on IBM eServer OpenPower 720 Cluster

SPECjAppServer®2004 Result
Copyright © 2004 Standard Performance Evaluation Corporation

WebSphere 6.0 Application Server on IBM eServer OpenPower 720 Cluster

1,334.96 SPECjAppServer2004 JOPS@Standard

Submitter:
IBM Corporation

SPEC license # 11

Test date:
Dec-2004

Software Products
WebSphere 6.0 Application Server Network Deployment
Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2)
IBM DB2 Universal JDBC Drivers
IBM DB2 V8.2
IBM Load balancer, Edge Component of WebSphere V6.0
WebSphere V6.0 Deployment Manager

Software Configurations
J2EE Application Servers
Emulator SW Config
Database SW Config
Driver SW Config Primary
Driver SW Config Satellites #1
IBM Load Balancer 6.0

Hardware Systems
J2EE Application Server HW
Database Server HW
Load Balancer and WebSphere Deployment Manager Hardware
Emulator
Load Drivers

System Configuration Diagram

Benchmark
Modifications
Configuration
Bill of Materials
Other Info
General Notes
Full Disclosure Archive

SUT Configuration

J2EE Server Nodes:	4	DB Server Nodes:	1
J2EE Server CPUs:	16 cores, 8 chips (SMT on)	DB Server CPUs:	4 cores, 2 chips (SMT on)
J2EE Instances:	4	DB Instances:	1

Other SUT Components:
(1) IBM eServer OpenPower 720 running IBM Load Balancer 6.0 and WebSphere Deployment Manager V6.0 (1) Cisco Catalyst 3750 Switch

Benchmark Settings

Dealer Injection Rate:	800	Ramp Up Time:	1,440 seconds
# of Dealer Agents:	8	Ramp Down Time:	300 seconds
# of Manufacturing Agents:	4	Steady State Time:	3,600 seconds
DB Load Injection Rate:	800	Trigger Time:	2,400 seconds

Detailed Results

Dealer Transaction Mix	Count	Tx. Mix
Purchase	723,713	25.04%
Manage	723,721	25.04%
Browse	1,442,649	49.92%
Total # Dealer Transactions	2,890,083

Total # Manufacturing Transactions	1,915,780

Response Times	Average	Maximum	90th%	Reqd
Purchase	0.50	5.34	1.10	2.00
Manage	0.45	7.94	1.00	2.00
Browse	0.59	4.54	1.20	2.00
Manufacturing	2.90	8.23	4.75	5.00

Reproducibility Run (SPECjAppServer2004 JOPS)	1,337.74

WebSphere 6.0 Application Server Network Deployment

Vendor:	IBM Corporation	Availability:	Dec-2004
CTS Version:	1.4	Date Passed CTS:	Nov-2004
OS Name:	SUSE LINUX Enterprise Server 9 for IBM POWER
EJB Protocol:	RMI/IIOP

Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2)

Vendor:	IBM Corporation	Availability:	Dec-2004
OS Name:	SUSE LINUX Enterprise Server 9 for IBM POWER

IBM DB2 Universal JDBC Drivers

Vendor:	IBM Corporation	Availability:	Dec-2004
OS Name:	SUSE LINUX Enterprise Server 9 for IBM POWER

IBM DB2 V8.2

Vendor:	IBM Corporation	Availability:	Dec-2004
OS Name:	SUSE LINUX Enterprise Server 9 for IBM POWER

IBM Load balancer, Edge Component of WebSphere V6.0

Vendor:	IBM Corporation	Availability:	Dec-2004
Description:	Load balancer via MAC forwarding

WebSphere V6.0 Deployment Manager

Vendor:	IBM Corporation	Availability:	Dec-2004
Description:	To setup and control WebSphere cell

J2EE Application Servers

J2EE Product:	WebSphere 6.0 Application Server Network Deployment
JVM Product:	Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2)
JDBC Product:	IBM DB2 Universal JDBC Drivers
Hardware:	J2EE Application Server HW
# of Instances:	4
Interfaces:
	Web Interface for the Dealer Domain
	Web Interface for the Supplier Domain
	EJB Interface for the Dealer Domain
	EJB Interface for the Manufacturing Domain
	EJB Interface for the Supplier Domain

Notes / Tuning Information

Minimum heap size = 2304 MB
Maximum heap size = 2304 MB
JVM parms: -Xlp -Djava.awt.headless=true
com.ibm.CORBA.FragmentSize=3000
com.ibm.ws.pm.batch=true
com.ibm.ws.pm.deferredcreate=true
EJB Cache Size = 30530
HTTP Channel maximum persistent requests = -1
HTTP Channel readTimeout = 6000
HTTP Channel writeTimeout = 6000
HTTP Channel persistentTimeout = 3000
Minimum Web Container threads = 38
Maximum Web Container threads = 38
Minimum ORB threads = 30
Maximum ORB threads = 30
Minimum Default threads = 10
Maximum Default threads = 10
Trace and PMI disabled
Log rotation disabled
Refer to files appservers/*.resources.xml and appservers/server.xml
in the archive file.  They contain datasource configuration and
other J2EE configuration information.

Emulator SW Config

JVM Product:	Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2)
Web Product:	WebSphere 6.0 Application Server Network Deployment
Hardware:	Emulator
# of Instances:	1

Notes / Tuning Information
Initial heap size = 512 MB Maximum heap size = 512 MB

Database SW Config

DB Product:	IBM DB2 V8.2
Hardware:	Database Server HW
# of Instances:	1

Notes / Tuning Information
Tuning performed by db2tune8.sh script in the archive/Schema directory.

Driver SW Config Primary

JVM Product:	Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2)
Hardware:	Load Drivers
# of Instances:	1

Notes / Tuning Information
JVM_OPTIONS=-Xss100k -Xms1024M -Xmx1024M -Dcom.ibm.CORBA.FragmentSize=3000

Driver SW Config Satellites #1

JVM Product:	Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2)
Hardware:	Load Drivers
# of Instances:	1

Notes / Tuning Information
JVM_OPTIONS=-Xss100k -Xms1024M -Xmx1024M -Dcom.ibm.CORBA.FragmentSize=3000

IBM Load Balancer 6.0

Other Product:	IBM Load balancer, Edge Component of WebSphere V6.0
Hardware:	Load Balancer and WebSphere Deployment Manager Hardware
# of Instances:	1

Notes / Tuning Information
Defaults used.

J2EE Application Server HW (SUT hardware)

Hardware Vendor:	IBM Corporation	OS Vendor:	Novell Inc.
Model Name:	IBM eServer OpenPower 720	OS Name:	SUSE LINUX Enterprise Server 9 for IBM POWER
Processor:	IBM POWER5	Filesystem:	Ext3, JFS
MHz:	1650	Disks:	2x36.4GB 10K RPM Ultra 320 SCSI (using software mirroring)
# of CPUs:	4 cores, 2 chips, 2 cores/chip (2 HW threads/chip)	Network Interface:	Dual 1000BASE-TX Gigabit Integrated Ethernet
Memory (MB):	4096	Other Hardware:
L1 Cache:	64KB(I)+32KB(D) per core	# of Systems:	4
L2 Cache:	1920KB unified (on chip) per chip	H/W Available:	Sep-2004
Other Cache:	36MB unified (off chip) per DCM, 2 DCMs	OS Available:	Aug-2004

Notes / Tuning Information

These entries added to a script (appservers/sjas4_tune.sh) that is run prior to each benchmark run:
  echo "20000" > /proc/sys/net/core/netdev_max_backlog
  echo "20000" > /proc/sys/net/core/somaxconn
  echo "30"    > /proc/sys/net/ipv4/tcp_fin_timeout
  echo "20"    > /proc/sys/net/ipv4/tcp_syn_retries
  echo "20"    > /proc/sys/net/ipv4/tcp_synack_retries
  echo "3" >/proc/sys/net/ipv4/conf/all/arp_ignore
  echo "2" >/proc/sys/net/ipv4/conf/all/arp_announce
  echo "144" > /proc/sys/vm/nr_hugepages
  echo "2415919104" > /proc/sys/kernel/shmmax
  echo "2415919104" > /proc/sys/kernel/shmall
  ulimit -n 10000
  ip addr add 9.3.32.147/32 scope host dev lo

Database Server HW (SUT hardware)

Hardware Vendor:	IBM Corporation	OS Vendor:	Novell Inc.
Model Name:	IBM eServer OpenPower 720	OS Name:	SUSE LINUX Enterprise Server 9 for IBM POWER
Processor:	IBM POWER5	Filesystem:	Ext3, JFS
MHz:	1650	Disks:	2x36.4GB 10K RPM SCSI
# of CPUs:	4 cores, 2 chips, 2 cores/chip (2 HW threads/chip)	Network Interface:	Dual 1000BASE-TX Gigabit Integrated Ethernet
Memory (MB):	16384	Other Hardware:	IBM 2-Gb Fibre Channel host bus adapter connected to IBM DS4300 Fibre Channel Array consisting of 14 * 18 GB FC disks.
L1 Cache:	64KB(I)+32KB(D) per core	# of Systems:	1
L2 Cache:	1920KB unified (on chip) per chip	H/W Available:	Sep-2004
Other Cache:	36MB unified (off chip) per DCM, 2 DCMs	OS Available:	Aug-2004

Notes / Tuning Information

These entries added to a script (database/sjas4_tune.sh) that is run prior to each benchmark run:
  ulimit -n 10000
  echo "752" > /proc/sys/vm/nr_hugepages
  echo "12616466432" > /proc/sys/kernel/shmmax
  echo "12616466432" > /proc/sys/kernel/shmall
The script database/db2_raw was run on boot to setup the raw device for the log
The script database/sched_fifo.sh was running during ramp up to modify process scheduling parameters
Added boot option "numa=off" to /etc/yaboot.conf

Load Balancer and WebSphere Deployment Manager Hardware (SUT hardware)

Hardware Vendor:	IBM Corporation	OS Vendor:	Novell Inc.
Model Name:	IBM eServer OpenPower 720	OS Name:	SUSE LINUX Enterprise Server 9 for IBM POWER
Processor:	IBM POWER5	Filesystem:	Ext3, JFS
MHz:	1500	Disks:	2x36.4GB 10K RPM Ultra 320 SCSI
# of CPUs:	2 cores, 1 chip, 2 cores/chip (2 HW threads/chip)	Network Interface:	Dual 1000BASE-TX Gigabit Integrated Ethernet
Memory (MB):	2048	Other Hardware:
L1 Cache:	64KB(I)+32KB(D) per core	# of Systems:	1
L2 Cache:	1920KB unified (on chip) per chip	H/W Available:	Sep-2004
Other Cache:	36MB unified (off chip) per DCM, 2 DCMs	OS Available:	Aug-2004

Notes / Tuning Information

These entries added to a script (dmgr_loadbalancer/sjas4_tune.sh) that is run prior to each benchmark run:
  echo "20000" > /proc/sys/net/core/netdev_max_backlog
  echo "20000" > /proc/sys/net/core/somaxconn
  echo "30"    > /proc/sys/net/ipv4/tcp_fin_timeout
  echo "20"    > /proc/sys/net/ipv4/tcp_syn_retries
  echo "20"    > /proc/sys/net/ipv4/tcp_synack_retries
  ulimit -n 10000
The config file (dmgr_loadbalancer/clusterconfig) was loaded prior to each run as follows:
  nohup dsserver
  dscontrol executor start
  dscontrol file newload clusterconfig

Emulator (non-SUT hardware)

Hardware Vendor:	IBM Corporation	OS Vendor:	Novell Inc.
Model Name:	IBM eServer xSeries 335	OS Name:	SUSE LINUX Enterprise Server 9
Processor:	Intel Xeon DP	Filesystem:	Ext3
MHz:	2800	Disks:	1x36.4GB 15K RPM Ultra 320 SCSI
# of CPUs:	2 cores, 2 chips, 1 core/chip (2 HW threads/chip)	Network Interface:	1000BASE-TX Gigabit
Memory (MB):	4096	Other Hardware:
L1 Cache:	12Kuops(I)+8KB(D) per chip	# of Systems:	1
L2 Cache:	512KB per chip	H/W Available:	May-2004
Other Cache:	2MB L3 cache per chip	OS Available:	Aug-2004

Notes / Tuning Information
These entries added to a script (emulator/sjas4_tune.sh) that is run prior to each benchmark run: ulimit -n 4096

Load Drivers (non-SUT hardware)

Hardware Vendor:	IBM Corporation	OS Vendor:	Novell Inc.
Model Name:	IBM eServer pSeries 690 Turbo	OS Name:	SUSE LINUX Enterprise Server 9 for IBM POWER
Processor:	IBM POWER4	Filesystem:	Ext3
MHz:	1700	Disks:	1x36.4GB 15K RPM Ultra 320 SCSI
# of CPUs:	8 cores, 4 chips, 2 cores/chip (1 HW threads/chip)	Network Interface:	1000BASE-TX Gigabit
Memory (MB):	32768	Other Hardware:
L1 Cache:	64KB(I)+32KB(D) on chip per core	# of Systems:	2
L2 Cache:	1536KB unified on chip per chip	H/W Available:	Jul-2003
Other Cache:	32MB unified (off-chip)/MCM, 1 MCM	OS Available:	Aug-2004

Notes / Tuning Information

These entries added to a script (*_driver/sjas4_tune.sh) that is run prior to each benchmark run:
  ulimit -n 50000
  echo "1000" > /proc/sys/net/core/netdev_max_backlog
  echo "2000" > /proc/sys/net/core/somaxconn
  echo "30"    > /proc/sys/net/ipv4/tcp_fin_timeout
  echo "20"    > /proc/sys/net/ipv4/tcp_synack_retries

Benchmark Modifications
Schema Modifications: No changes were made to the benchmark schema.
Load Program Modifications: No changes were made to the load program.

Benchmark Configuration Information
Isolation Requirement Info: The following beans: PartEnt, ComponentEnt, AssemblyEnt, BomEnt and LargeOrderEnt in the Manufacturing Domain, ItemEnt in the Orders Domain, and SupplierCompEnt and SupplierEnt in the Supplier Domain were accessed using READ_COMMITTED (Access Intent's of wsOptimisticUpdate or wsOptimisticRead) which is Cursor Stability (CS) for DB2. The remaining beans were accessed using REPEATABLE_READ (Access Intent's of wsPessimisticUpdate, wsPessimisticRead or wsPessimisticWeakestLockAtLoad) which translates to DB2 isolation level of Read Stability (RS). The ItemEnt bean was cached for 20 minute intervals using the WebSphere Read Only Bean Mechanism. Only the data inside the bean was cached.
Durability Requirement Info: To ensure database durability, RAID 5 was used for the database logs maintained on the DS4300 Storage Expansion Units.
Storage Requirement Info: Over the course of a 89 minute run at an injection rate of 800, the database storage for database system increased by 914 MB; Given a linear scale, a 24 hour run at the same injection rate would increase storage for database system by 14784 MB. The DS4300 disk array each contain seven 18 GB drives. The DS4300 controller utilized these drives as a RAID 0 array, yielding 126 GB for available storage.
Argument Passing Semantics: WebSphere Application Server V6.0 uses pass-by-value semantics by default.

Bill of Materials


        IBM eServer OpenPower 720 WebSphere 6.0 Cluster with DB2 v8.2 Database Server 
            

Supplier        IBM eServer OpenPower 720 WebSphere V6 Hardware (for four systems) 
     Unit Qty   Description                                           Part Number

IBM      4      9124 Model 720                                        9124-720
IBM     16      1024MB (4x256MB) DIMMs, 208-pin, 266 MHz DDR SDRAM         1937
IBM      4      IDE Slimline DVD-ROM Drive                                 2640
IBM      8      36.4 GB 10,000 RPM Ultra320 SCSI Disk Drive                3273
IBM      8      2-way 1.65 GHz POWER5 Processor Card, 36MB L3 Cache        5262
IBM      4      Power Cable -- Drawer to IBM PDU, 250v/10A                 6458
IBM      4      4-Disk Slot Exp - Base Ctlr                                6592
IBM      4      IBM Rack-mount Drawer Rail Kit                             7162
IBM      8      CPU Power Regulator                                        7876
IBM      4      Media Backplane Card                                       7877
IBM      4      1475W AC Power Supply                                      7889
IBM      4      720 Rack Mount                                             7914
IBM      4      Language Group: US English                                 9300
IBM      4      3 year support, 24x7x4                                38R3592


Supplier        IBM eServer OpenPower 720 Database Hardware (for one system)        
     Unit Qty   Description                                           Part Number

IBM      1      9124 Model 720                                        9124-720
IBM      4      4096MB (4x1024MB) DIMMs, 208-pin, 266 MHz DDR SDRAM        1940
IBM      1      IDE Slimline DVD-ROM Drive                                 2640
IBM      2      36.4 GB 10,000 RPM Ultra320 SCSI Disk Drive                3273
IBM      2      2-way 1.65 GHz POWER5 Processor Card, 36MB L3              5262
IBM      1      2 Gigabit Fibre Channel PCI-X Adapter                      5716
IBM      1      Power Cable -- Drawer to IBM PDU, 250v/10A                 6458
IBM      1      4-Disk Slot Exp - Base Ctlr                                6592
IBM      1      IBM Rack-mount Drawer Rail Kit                             7162
IBM      2      CPU Power Regulator                                        7876
IBM      1      Media Backplane Card                                       7877
IBM      1      1475W AC Power Supply                                      7889
IBM      1      720 Rack Mount                                             7914
IBM      1      Language Group: US English                                 9300
IBM      1      3 year suport, 24x7x4                                 38R3592   


Supplier         IBM Storage Hardware (for database system)   
     Unit Qty    Description                                          Part Number

IBM      1       DS4300 Midrange Disk (6LU)                           1720-6LU
IBM      1       Short Wave SFP GBIC (LC)                                  2210
IBM     14       2Gb FC, 18.2GB/15K Drive Module                           5211
IBM      1       DS4300 Linux for Power Host Kit                           7714
IBM      1       Field Integrate DS4300                                    9202
IBM	 1	 3 year support, 24x7x4				      96P2368
                        

Supplier        IBM eServer OpenPower 720 Load Balancer and Deployment Manager Hardware (for one system)        
     Unit Qty   Description                                           Part Number

IBM      1      9124 Model 720                                        9124-720
IBM      2      1024MB (4x256MB) DIMMs, 208-pin, 266 MHz DDR SDRAM         1937
IBM      1      IDE Slimline DVD-ROM Drive                                 2640
IBM      2      36.4 GB 10,000 RPM Ultra320 SCSI Disk Drive                3273
IBM      2      2-way 1.5 GHz POWER5 Processor Card, L3 Cache              1961
IBM      1      Power Cable -- Drawer to IBM PDU, 250v/10A                 6458
IBM      1      4-Disk Slot Exp - Base Ctlr                                6592
IBM      1      IBM Rack-mount Drawer Rail Kit                             7162
IBM      2      CPU Power Regulator                                        7876
IBM      1      Media Backplane Card                                       7877
IBM      1      1475W AC Power Supply                                      7889
IBM      1      720 Rack Mount                                             7914
IBM      1      Language Group: US English                                 9300
IBM      1      3 year suport, 24x7x4                                 38R3592
                        

Supplier        Miscellaneous Hardware
     Unit Qty   Description                                           Part Number 
IBM      1      HMC 1:7310-C03 Desktop Hardw.Mgmt.Console             7310-C03
IBM      1      Quiet Touch Keyboard - USB, Business Black,                8800
IBM      1      Mouse - Business Black with Keyboard Attachment Cable      8841
IBM	 1	IBM ThinkVision L170 Monitor                               3631
IBM	 1	HMC Support, 3 year, 24x7x4			           0569
IBM      1      NetBAY42 ER Enterprise Rack                           930842S
IBM      1      NetBay - 3yr Warranty Service Upgrade (24x7x4)        41L2762
CDW      1      Cisco 3750-24-TS                                      497268
CDW      3      Cisco Support 1 year, 24x7x4                          150984


									
			
Supplier        Passport Advantage Software	
     Unit Qty   Description                                                                 Part Number 
IBM      8	DB2 UDB WORKGROUP SERVER UNLIMITED EDITION PROCESSOR LIC+SW MAINT 12 MO     D51NDLL
IBM     16	DB2 UDB WORKGROUP SERVER UNLIMITED EDITION PROCESSOR SW MAINT RNWL 1 ANNIV  E00IHLL
IBM      1	WAS NETWORK DEPLOYMENT V6.0.0 Multilingual MEDIA PK                         BA0DMML
IBM     22      WAS Network Deployment Per Processor License & SW Maintenance 12 Months     D5ALTLL
IBM     44      WAS Network Deployment Per Processor SW Maintenance Annual Renewal          E1ALVLL
IBM      1	EDGE SERVER - LOAD BALANCING, CACHING,CENTRALIZED SECURITY included in      D5ALTLL
IBM      1	EDGE SERVER - SUPPORT                   included in E1ALVLL
         		
         		
Supplier        Operating System Software	
     Unit Qty   Description                                           Part Number
SuSE     1      SUSE LINUX ENTERPRISE SERVER 9 FOR POWER              5639-SLP
SuSE     6      PREMIUM SUPPORT FOR SLES9 POWER FOR 3 YEARS           SUSE QUOTE
SuSE     6      MAINTENANCE PROGRAM FOR SLES9 X86 FOR 3 YEARS         SUSE QUOTE

Other Benchmark Information

  The switch ports and all network adapters are 1Gb/sec.
  
  Two types of load balancing were utilized:
    WebSphere's workload management performed load balancing for RMI/IIOP requests.
    IBM Load Balancer balanced HTTP connections across the WebSphere nodes.
  
  This submission used the xerces implementation (version - XML4J 4.3) provided
  with WebSphere Application Server V6.0 in the IBM 1.4.2 JDK.

General Notes

The only errors in the driver log files were those that are normally generated by this benchmark.

The IBM DB2 Universal JDBC Drivers is a type 4 driver.

DB2 uses "Soft" checkpoint to ensure that no updates remain unflushed for
longer than the allowed time.

When DB2 UDB Server changes a database table with an update, insert, or delete
operation, the change is initially made in memory, not on disk. When there is
not enough space in the memory buffer to read in or write additional data pages,
DB2 UDB Server will make space by flushing some modified pages to disk.
Modified pages are also written to disk as part of the "Soft" checkpoint to
ensure that no updates remain unflushed for longer than the allowed time.
Before a change is made to the database, it is first recorded in the
transaction log. This ensures that the database can be recovered completely
in the event of a failure. Using the transaction log, transactions that
started but did not complete prior to a failure can be undone, and
transactions recorded as complete in the transaction log but not yet written
to disk can be redone.

DB2 UDB uses a write-ahead-logging protocol to guarantee recovery. This
protocol uses "Soft" checkpoint to write least-recently-used database pages
to disk independent of transaction commit. However, enough log information to
redo/undo the change to a database pages is committed to disk before the
database page itself is written. This protocol therefore renders checkpoint
unnecessary for DB2 UDB. For a more detailed description of the general
principles of the write-ahead-logging protocol, see the IBM research paper,
ARIES: A Transaction Recovery Method Supporting Fine Granularity Locking and
Partial Rollbacks Using Write-Ahead Logging," by C. Mohan, Database Technology
Institute, IBM Almaden Research Center. (http:// portal.acm.org/citation.cfm
?id=128770&coll=portal&dl=ACM&CFID=10343790&CFTOKEN=42047146)

1-phase transactions were used to coordinate the interaction between the database
server and JMS servers.

For questions about this result, please contact the submitter: IBM Corporation
For other inquiries, please contact webmaster@spec.org

Benchmark run on Wed Dec 15 10:45:11 CST 2004 by SPECjAppServer2004 v1.03
Result submitted on Wed Dec 22 03:03:01 EST 2004
Report generated by SPECjAppServer2004 Reporter v1.03

First published at SPEC.org on 05-Jan-2005