SPECjEnterprise2010 Result: WebSphere Application Server V7 on IBM Power 780 and DB2 9.7 on IBM Power 750 Express

SPECjEnterprise®2010 Result
Copyright © 2009-2011 Standard Performance Evaluation Corporation

WebSphere Application Server V7 on IBM Power 780 and DB2 9.7 on IBM Power 750 Express

16,646.34 SPECjEnterprise2010 EjOPS

Submitter:
IBM Corporation

SPEC license # 11

Test date:
Feb-2011

Software Products
WebSphere Application Server V7 with Feature Pack for OSGi Applications and Java Persistence API 2.0
IBM J9 VM (build 2.4, JRE 1.6.0 IBM J9 2.4 AIX ppc-32)
IBM J9 VM (build 2.4, JRE 1.6.0 IBM J9 2.4 Linux amd64-64)
IBM DB2 Universal JDBC Drivers (3.61.75)
DB2 9.7 FP3a

Software Configurations
JEE Application Server
Emulator Software Config
Database Software Config
Driver Config

Hardware Systems
JEE AppServer HW
Database Server HW
Load Driver HW
Emulator HW

System Configuration Diagram

Benchmark
Modifications
Configuration
Bill of Materials
Other Info
General Notes
Full Disclosure Archive

SUT Configuration

JEE Server Nodes:	1	DB Server Nodes:	1
JEE Server CPUs:	64 cores, 8 chips	DB Server CPUs:	32 cores, 4 chips
JEE Instances:	32	DB Instances:	1

Other SUT Components:
4 x 3Com Switch 4200G 48-Port Switches

Benchmark Settings

Dealer Injection Rate:	10,480	Ramp Up Time:	2,400 seconds
DB Load Injection Rate:	20,000	Steady State Time:	3,600 seconds
# of Dealer Agents:	104,800	Ramp Down Time:	300 seconds
# of Manufacturing Agents:	31,440

Detailed Results

Dealer Transaction Mix	Count	Tx. Mix	Failure Count
Purchase	9,454,881	25.00%	12
Manage	9,454,238	25.00%	9
Browse	18,903,374	49.99%	0
Total # Dealer Transactions	37,812,493

Manufacturing Transaction Mix	Count	Tx. Mix	Failure Count
CreateVehicleEJB	11,052,480	49.98%	6,982
CreateVehicleWS	11,061,849	50.02%	6,810
Total # Manufacturing Transactions	22,114,329

Response Times	Average	Standard Deviation	Maximum	90th%	Reqd
Purchase	0.452	0.83	19.812	1.270	2.000
Manage	0.272	0.42	17.427	0.680	2.000
Browse	0.605	0.98	17.669	1.900	2.000
CreateVehicleEJB	0.222	0.15	5.038	0.375	5.000
CreateVehicleWS	0.239	0.23	7.647	0.400	5.000

Reproducibility Run (SPECjEnterprise2010 EjOPS)	16,659.23

WebSphere Application Server V7 with Feature Pack for OSGi Applications and Java Persistence API 2.0

Vendor:	IBM Corporation	Availability:	Oct-2010
CTS Version:	5.0	Date Passed CTS:	Sep-2008
OS Name:	IBM AIX V7.1
EJB Protocol:	RMI/IIOP

IBM J9 VM (build 2.4, JRE 1.6.0 IBM J9 2.4 AIX ppc-32)

Vendor:	IBM Corporation	Availability:	Oct-2010
OS Name:	IBM AIX V7.1

IBM J9 VM (build 2.4, JRE 1.6.0 IBM J9 2.4 Linux amd64-64)

Vendor:	IBM Corporation	Availability:	Oct-2010
OS Name:	Novell SUSE Linux Enterprise Server 10 SP3

IBM DB2 Universal JDBC Drivers (3.61.75)

Vendor:	IBM Corporation	Availability:	Oct-2010
OS Name:	IBM AIX V7.1

DB2 9.7 FP3a

Vendor:	IBM Corporation	Availability:	Oct-2010
OS Name:	IBM AIX V7.1

JEE Application Server

JEE Product:	WebSphere Application Server V7 with Feature Pack for OSGi Applications and Java Persistence API 2.0
JVM Product:	IBM J9 VM (build 2.4, JRE 1.6.0 IBM J9 2.4 AIX ppc-32)
JDBC Product:	IBM DB2 Universal JDBC Drivers (3.61.75)
Hardware:	JEE AppServer HW
# of Instances:	32
Interfaces:
	Web Interface for the Order Domain
	Web Services Interface for the Supplier Domain
	EJB Interface for the Manufacturing Domain
	Web Services Interface for the Manufacturing Domain

Notes / Tuning Information

JVM Parameters:
-Xms2304m -Xmx2304m -Xss128k -Xgcpolicy:gencon -Xnoloa -Xmo500m -Xmn1804m -Xtrace:none -Xlp -Xaggressive -XtlhPrefetch -Xcodecache32m
-Xgcthreads4 -Xdisableexplicitgc -Dcom.ibm.CORBA.FragmentSize=10000 -Djavax.xml.transform.TransformerFactory=org.apache.xalan.processor.TransformerFactoryImpl
-Djavax.xml.parsers.SAXParserFactory=org.apache.xerces.jaxp.SAXParserFactoryImpl
-Djavax.xml.parsers.DocumentBuilderFactory=org.apache.xerces.jaxp.DocumentBuilderFactoryImpl
-Djava.net.preferIPv4Stack=true -Dsun.net.inetaddr.ttl=0
Websphere Application Server AIO disabled
Refer to files appservers/node.resources.xml, and appservers/server.xml
for all server configuration and resource configuration
information

Emulator Software Config

JEE Product:	WebSphere Application Server V7 with Feature Pack for OSGi Applications and Java Persistence API 2.0
JVM Product:	IBM J9 VM (build 2.4, JRE 1.6.0 IBM J9 2.4 Linux amd64-64)
Hardware:	Emulator HW
# of Instances:	16

Notes / Tuning Information

JVM Parameters:
-Xms2048m -Xmx2048m -Xss128k -Xgcpolicy:gencon -Xnoloa -Xmo512m -Xmn1536m -Xtrace:none -DdisableWSAddressCaching=true
-Xgcthreads8 -Xdisableexplicitgc -Djavax.xml.transform.TransformerFactory=org.apache.xalan.processor.TransformerFactoryImpl
-Djavax.xml.parsers.SAXParserFactory=org.apache.xerces.jaxp.SAXParserFactoryImpl
-Djavax.xml.parsers.DocumentBuilderFactory=org.apache.xerces.jaxp.DocumentBuilderFactoryImpl
-Djava.net.preferIPv4Stack=true -Dsun.net.inetaddr.ttl=0
Refer to files emulator/server.xml
for all server configuration and resource configuration
information

Database Software Config

DB Product:	DB2 9.7 FP3a
Hardware:	Database Server HW
# of Instances:	1
Character Set:	UTF-8

Notes / Tuning Information

DB2_COLLECT_TS_REC_INFO=FALSE
DB2_LARGE_PAGE_MEM=DB
DB2_APM_PERFORMANCE=ON
DB2_KEEPTABLELOCK=CONNECTION
DB2_MINIMIZE_LISTPREFETCH=YES
DB2_USE_ALTERNATE_PAGE_CLEANING=ON
DB2_RESOURCE_POLICY=/specdata8/db2inst1/scripts/ir20k/affinity.cfg
DIAGLEVEL 3
DFT_MON_BUFPOOL on
DFT_MON_LOCK off
DFT_MON_SORT off
DFT_MON_STMT off
DFT_MON_TIMESTAMP on
DFT_MON_UOW off
DFT_MON_TABLE off
CPUSPEED -1
MAX_COORDAGENTS 4800 automatic
HEALTH_MON off
LOGBUFSZ 4096
LOGPRIMARY 150
SOFTMAX 3000
CHNGPGS_THRESH 99
LOGFILSIZ 65535
LOGSECOND 0
NEWLOGPATH /dev/rloglv
AUTO_MAINT off
AUTO_RUNSTATS off
AUTO_TBL_MAINT off
NUM_IOCLEANERS 32
MAXLOCKS 100
LOCKLIST 100000
MINCOMMIT 1
MON_REQ_METRICS none
MON_ACT_METRICS none
MON_OBJ_METRICS none
AUTO_STMT_STATS off
IBMDEFAULTBP immediate size 30000000
SPEC_BP immediate size 35214400
JMS_BP immediate size 5000
O_ORDERLINE append on
O_CUSTINVENTORY append on
O_ORDERS append on
PURCH_ORDER append on
S_PURCH_ORDERLINE append on
M_WORKORDER append on
M_WORKORDER volatile
O_ITEM volatile
M_PARTS volatile
M_INVENTORY volatile

Driver Config

JVM Product:	IBM J9 VM (build 2.4, JRE 1.6.0 IBM J9 2.4 Linux amd64-64)
Hardware:	Load Driver HW
# of Instances:	16

Notes / Tuning Information

-Xms2048M -Xmx2048M -Djava.net.preferIPv4Stack=true -Dcom.ibm.websphere.naming.hostname.normalizer=...none...
-Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0 -Dcom.ibm.CORBA.FragmentSize=10000
-Dcom.ibm.CORBA.ConnectionMultiplicity=28 -DdisableWSAddressCaching=true

JEE AppServer HW (SUT hardware)

Hardware Vendor:	IBM Corporation	OS Vendor:	IBM Corporation
Model Name:	IBM Power 780	OS Name:	IBM AIX V7.1
Processor:	POWER7 (Intelligent Energy Optimization up to 3.94 GHz)	Filesystem:	AIX/JFS2
MHz:	3860	Disks:	1x146GB 15K RPM
# of CPUs:	64 cores, 8 chips, 8 cores/chip (32 HW threads/chip)	Network Interface:	(32) 1000BaseT Ethernet and (1) 10GBaseR
Memory (MB):	524288	Other Hardware:
DIMM[0] Count:	64	DIMM[0] Size:	8192
L1 Cache:	32 KB I + 32 KB D on chip per core	# of Systems:	1
L2 Cache:	256 KB I+D on chip per core	H/W Available:	Mar-2010
Other Cache:	4 MB I+D on chip per core	OS Available:	Sep-2010

Notes / Tuning Information

vmo -o lgpg_regions=16384 -o lgpg_size=16777216 -o v_pinshm=1
dscrctl -n -s 1
MEMORY_AFFINITY=MCM
EXTSHM=OFF
SPINLOOPTIME=4000
AIXTHREAD_SCOPE=S
LDR_CNTRL=DATAPSIZE=64k@STACKPSIZE=64k@TEXTPSIZE=64k@MAXDATA=0xB0000000@DSA
ulimit -s unlimited; ulimit -d unlimited; ulimit -m unlimited; ulimit -f unlimited; ulimit -n unlimited
ctctrl -P memtraceoff
errctrl -P errcheckoff
raso -r -o mtrc_enabled=0
skeyctl -u 0
skeyctl -k off
no -r -o net_malloc_police=0
setsched -P 61 -S rr -p $$
Network Tuning:
  rxbuf_pool_sz=4096
  rxdesc_que_sz=2048
  intr_rate=10000
  Network interrupt bound to a core corresponding to the server instance
Server instances were started using execrset, binding 4 instances per chip.
Intelligent Energy Optimization enabled, up to 3.93 GHz
IBM Systems Director is required to enable the Intelligent Energy Optimization

Database Server HW (SUT hardware)

Hardware Vendor:	IBM Corporation	OS Vendor:	IBM Corporation
Model Name:	IBM Power 750 Express	OS Name:	IBM AIX V7.1
Processor:	POWER7	Filesystem:	AIX/JFS2
MHz:	3556	Disks:	1x146GB 15K RPM
# of CPUs:	32 cores, 4 chips, 8 cores/chip	Network Interface:	(8) 1000BaseT Ethernet and (1) 10GBaseR
Memory (MB):	524288	Other Hardware:	1xDS5300 Disk System, 8xEXP5000 Expansion Disk Arrays, 128x146GB 15K E-DDM Disks
DIMM[0] Count:	32	DIMM[0] Size:	16384
L1 Cache:	32 KB I + 32 KB D on chip per core	# of Systems:	1
L2 Cache:	256 KB I+D on chip per core	H/W Available:	Feb-2010
Other Cache:	4 MB I+D on chip per core	OS Available:	Sep-2010

Notes / Tuning Information

vmo -o lgpg_regions=22400 -o lgpg_size=16777216 -o v_pinshm=1
ulimit -s unlimited; ulimit -d unlimited; ulimit -m unlimited; ulimit -f unlimited; ulimit -n unlimited
dscrctl -n -s 1
MEMORY_AFFINITY=MCM
LDR_CNTRL=DATAPSIZE=64k@STACKPSIZE=64k@TEXTPSIZE=64k
ctctrl -P memtraceoff
errctrl -P errcheckoff
raso -r -o mtrc_enabled=0
skeyctl -u 0
skeyctl -k off
no -r -o net_malloc_police=0
Queue depth set to 32 for all external storage disks

Load Driver HW (non-SUT hardware)

Hardware Vendor:	IBM Corporation	OS Vendor:	Novell
Model Name:	IBM BladeCenter HS21	OS Name:	Novell SUSE Linux Enterprise Server 10 SP3
Processor:	Quad Core Intel(R) Xeon(R) X5470	Filesystem:	Reiser
MHz:	3333	Disks:	1 x 73.4GB SAS 15K rpm
# of CPUs:	8 cores, 2 chips, 4 cores/chip	Network Interface:	(4) 1000BaseT
Memory (MB):	16384	Other Hardware:
L1 Cache:	32KB(I)+32KB(D)	# of Systems:	16
L2 Cache:	2x6MB per chip	H/W Available:	Nov-2008
Other Cache:		OS Available:	May-2009

Notes / Tuning Information

fs.file-max = 1048576
kernel.sem = 250 32000 100 128
kernel.shmall = 4294967296
kernel.shmmax = 68719476736
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.wmem_default = 30000000
net.core.rmem_max = 30000000
net.core.wmem_max = 30000000
net.core.somaxconn = 300000
net.ipv4.conf.default.rp_filter = 1
net.ipv4.conf.default.accept_source_route = 0
net.ipv4.ip_forward = 0
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem  = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_wmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_sack = 0
net.ipv4.conf.all.arp_announce = 2
net.ipv4.conf.all.arp_ignore = 1
ulimit -n 1048576

Emulator HW (non-SUT hardware)

Hardware Vendor:	IBM Corporation	OS Vendor:	Novell
Model Name:	IBM BladeCenter HS21	OS Name:	Novell SUSE Linux Enterprise Server 10 SP3
Processor:	Quad Core Intel(R) Xeon(R) X5470	Filesystem:	Reiser
MHz:	3333	Disks:	1 x 73.4GB SAS 15K rpm
# of CPUs:	8 cores, 2 chips, 4 cores/chip	Network Interface:	(4) 1000BaseT
Memory (MB):	16384	Other Hardware:
L1 Cache:	32KB(I)+32KB(D)	# of Systems:	8
L2 Cache:	2x6MB per chip	H/W Available:	Nov-2008
Other Cache:		OS Available:	May-2009

Notes / Tuning Information

fs.file-max = 1048576
kernel.sem = 250 32000 100 128
kernel.shmall = 4294967296
kernel.shmmax = 68719476736
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.wmem_default = 30000000
net.core.rmem_max = 30000000
net.core.wmem_max = 30000000
net.core.somaxconn = 300000
net.ipv4.conf.default.rp_filter = 1
net.ipv4.conf.default.accept_source_route = 0
net.ipv4.ip_forward = 0
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem  = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_wmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_sack = 0
net.ipv4.conf.all.arp_announce = 2
net.ipv4.conf.all.arp_ignore = 1
ulimit -n 1048576

Benchmark Modifications
Schema Modifications: Modifications to the schema where made to enable range partitioning. The DDL for creating the range partion tables that were used is included in the FDA under the schema/create_partition.ddl
Load Program Modifications: No modifications to the load programs were made.

Benchmark Modifications

Schema Modifications:

  Modifications to the schema where made to enable range partitioning.
  The DDL for creating the range partion tables that were used is
  included in the FDA under the schema/create_partition.ddl

Load Program Modifications:

  No modifications to the load programs were made.

Benchmark Configuration Information

Isolation Requirement Info:

  The benchmark meets the isolation level requirements by version column
    checking on entities against the database.
  The ItemEnt bean was cached for 20 minute intervals using
    the WebSphere JPA Object Cache mechanism.

Durability Requirement Info:

  To ensure database durability, RAID10 was used for the
    database logs maintained on the external storage.
    A total of 64 x 146GB disks were used for the log.

Storage Requirement Info:

  Over the course of a 85 minute run at an injection rate of
    10480, the database storage for database system increased by
    12.2 GB.  Given a linear scale, a 24 hour run at the same
    injection rate would increase storage for database system
    by 206 GB.  One RAID10 disk arrays were used to create the
    filesystem space for the database.  The array contained
    56 x 146GB disks providing 8176 GB of storage.

Bill of Materials

Supplier  Description                                         Product #           Qty
--------  -------------------------------------------         ----------------    ---
IBM       IBM Power 780	                                      9179-MHB             1
-            8x8-core POWER7 Processor
-            (3.86GHz 4MB L3 Cache per core)
-            512GB RAM (64x8GB DIMMS), 1x146.8GB 15k SAS HDD
-            3 Year Onsite Repair 24x7 4 Hour Response     	                     "	
IBM       AIX Standard Edition V7.1 per processor             5765-G98-0017        64
IBM       AIX 3 year support per processor                    5773-SM3-1259        64
...
IBM       IBM Power 750 Express                               8233-E8B              1
-            4x8-core POWER7 Processor
-            (3.55GHz 4MB L3 Cache per core)
-            512GB RAM (32x16GB DIMMS), 1x146.8GB 15k SAS HDD
-            3 Year Onsite Repair 24x7 4 Hour Response     	
IBM       DS5300 Midrange Disk(Dual Controller,8 GB Cache)    1818-53A              1
IBM       IBM EXP5000 Storage Expansion Unit	              1812-D1A              8
IBM       4Gbps FC, 146.8 GB/15K DDM	                      5510                128
IBM       AIX Standard Edition V7.1 per processor             5765-G98-0008        32
IBM       AIX 3 year support per processor                    5773-SM3-1253        32
...
CDW       3Com Switch 4200G 48-Port                           1020899               4
CDW       10GBASE-CX4 XENPAK Infiniband 4x Module             3CXENPAK95            6
CDW       3Com Switch 4200G 48-Port Sup 1 yr, 24x7x4          819638               12
...
IBM       DB2 Enterprise Server Edition 9.7                   D597RLL              32*
-           Lic+SW Maint 12 Months
IBM       DB2 Enterprise Server Edition 9.7		      E00BILL              64
-           SW Maint Rewl 1 Anniv
IBM       WebSphere Application Server V7                     D55W8LL              64**
-           Lic+SW Maint 12 Months
-           Fix Pack 13 (7.0.0.13)
-           PM20973
-           Feature Pack for OSGi Applications and Java Persistence API 2.0
-           OSGi & JPA Fix Pack 1.0.0.1
IBM       WebSphere Application Server V7	              E1CBBLL             128
-           SW Maint Rewl 1 Anniv
...
* Note:  Pricing for DB2 is based on Processor Value Units (PVU).  Each POWER7 core is 100 PVU.
** Note:  Pricing for WebSphere is based on Processor Value Units (PVU).  Each POWER7 core is 120 PVU.

Other Benchmark Information
DNS round robin load balancing was used and hosted on the database machine All network connections were 1Gbps

General Notes

All exceptions in driver logs are from Optimistic Concurrency Checking.
These exceptions are expected in the benchmark.

The IBM DB2 Universal JDBC Drivers is a type 4 driver.

DB2 uses "Soft" checkpoint to ensure that no updates remain unflushed for
longer than the allowed time.

When DB2 UDB Server changes a database table with an update, insert, or delete
operation, the change is initially made in memory, not on disk. When there is
not enough space in the memory buffer to read in or write additional data pages,
DB2 UDB Server will make space by flushing some modified pages to disk.
Modified pages are also written to disk as part of the "Soft" checkpoint to
ensure that no updates remain unflushed for longer than the allowed time.
Before a change is made to the database, it is first recorded in the
transaction log. This ensures that the database can be recovered completely
in the event of a failure. Using the transaction log, transactions that
started but did not complete prior to a failure can be undone, and
transactions recorded as complete in the transaction log but not yet written
to disk can be redone.

DB2 UDB uses a write-ahead-logging protocol to guarantee recovery. This
protocol uses "Soft" checkpoint to write least-recently-used database pages
to disk independent of transaction commit. However, enough log information to
redo/undo the change to a database pages is committed to disk before the
database page itself is written. This protocol therefore renders checkpoint
unnecessary for DB2 UDB. For a more detailed description of the general
principles of the write-ahead-logging protocol, see the IBM research paper,
ARIES: A Transaction Recovery Method Supporting Fine Granularity Locking and
Partial Rollbacks Using Write-Ahead Logging," by C. Mohan, Database Technology
Institute, IBM Almaden Research Center. (http:// portal.acm.org/citation.cfm
?id=128770&coll=portal&dl=ACM&CFID=10343790&CFTOKEN=42047146)

For questions about this result, please contact the submitter: IBM Corporation
For other inquiries, please contact webmaster@spec.org

Benchmark run on Tue Feb 01 08:04:21 CST 2011 by SPECjEnterprise2010 v1.02
Result submitted on null
Report generated by SPECjEnterprise2010 Reporter v1.00

First published at SPEC.org on 23-Feb-2011