SPEC Seal of Reviewal SPECjAppServer®2004 Result
Copyright © 2004 Standard Performance Evaluation Corporation
Oracle WebLogic Server Standard Edition Release 10.3 on Dell PowerEdge R610
3,975.13 SPECjAppServer2004 JOPS@Standard
Submitter:
Oracle Corporation		 SPEC license # 73 Test date:
Mar-2009
Software Products
Oracle WebLogic Server Standard Edition Release 10.3
Oracle JRockit(R) 6.0 JDK (R27.6.0-50) (Linux x86 32bit)
Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_07
Oracle JDBC Driver 11.1.0.6 (Thin)
Oracle Database Enterprise Edition Release 11.1.0.7 		Software Configurations
J2EE Application Server
Emulator SW Config
Database SW Config
Driver SW Config Primary and Satellites 		Hardware Systems
J2EE Application Server
Database Server HW
Primary Driver HW
Satellite Driver #1 and #2 HW
Emulator HW

System Configuration Diagram

Benchmark
Modifications
Configuration
Bill of Materials
Other Info
General Notes
Full Disclosure Archive

SUT Configuration
J2EE Server Nodes: 1   DB Server Nodes: 1
J2EE Server CPUs: 8 cores, 2 chips   DB Server CPUs: 24 cores, 4 chips
J2EE Instances: 4   DB Instances: 1
Other SUT Components:
   1x Dell PowerConnect 6248 Managed Switch

Benchmark Settings
Dealer Injection Rate: 2,380   Ramp Up Time: 600 seconds
# of Dealer Agents: 9   Ramp Down Time: 300 seconds
# of Manufacturing Agents: 10   Steady State Time: 3,600 seconds
DB Load Injection Rate: 3,000   Trigger Time: 790 seconds

Detailed Results
Dealer Transaction Mix Count Tx. Mix
Purchase 2,148,634 25.01%
Manage 2,145,969 24.98%
Browse 4,296,967 50.01%
Total # Dealer Transactions 8,591,570
Total # Manufacturing Transactions 5,718,899
Response Times Average Maximum 90th% Reqd
Purchase 0.58 13.26 1.40 2.00
Manage 0.31 13.31 0.80 2.00
Browse 0.72 10.37 1.70 2.00
Manufacturing 2.50 9.43 4.00 5.00
Reproducibility Run (SPECjAppServer2004 JOPS) 3,981.26

Oracle WebLogic Server Standard Edition Release 10.3
Vendor: Oracle Corporation Availability: Aug-2008
CTS Version: 5.0 Date Passed CTS: Feb-2007
OS Name: Oracle Enterprise Linux 5 Update 3 x86_64
EJB Protocol: RMI/T3

Oracle JRockit(R) 6.0 JDK (R27.6.0-50) (Linux x86 32bit)
Vendor: Oracle Corporation Availability: Jul-2008
OS Name: Oracle Enterprise Linux 5 Update 3 x86_64

Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_07
Vendor: Sun Microsystems, Inc Availability: Jul-2008
OS Name: Red Hat Enterprise Linux 5 Update 1 EM64T

Oracle JDBC Driver 11.1.0.6 (Thin)
Vendor: Oracle Corporation Availability: Oct-2007
OS Name: Oracle Enterprise Linux 5 Update 3 x86_64

Oracle Database Enterprise Edition Release 11.1.0.7
Vendor: Oracle Corporation Availability: Aug-2008
OS Name: Oracle Enterprise Linux 5 Update 2 x86_64

J2EE Application Server
J2EE Product: Oracle WebLogic Server Standard Edition Release 10.3
JVM Product: Oracle JRockit(R) 6.0 JDK (R27.6.0-50) (Linux x86 32bit)
JDBC Product: Oracle JDBC Driver 11.1.0.6 (Thin)
Hardware: J2EE Application Server
# of Instances: 4
Interfaces:
Web Interface for the Dealer Domain
Web Interface for the Supplier Domain
EJB Interface for the Dealer Domain
EJB Interface for the Manufacturing Domain
EJB Interface for the Supplier Domain
Notes / Tuning Information 
-showversion -Xms3650M -Xmx3650M -XXaggressive -XXinternalCompactRatio=1
-XXexternalCompactRatio=10 -XXheapParts=256 -XXgcthreads=4 -XXoptthreads=4
-Xverbose:gcpause,gcreport -XXtlasize:min=4k,preferred=64k -showversion
-Dweblogic.MuxerClass=weblogic.socket.NIOSocketMuxer -Dweblogic.SocketReaders=1
-Dweblogic.management.discover=false -Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true

Emulator SW Config
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_07
Web Product: Oracle WebLogic Server Standard Edition Release 10.3
Hardware: Primary Driver HW
# of Instances: 1
Notes / Tuning Information 
-server -Xms13g -Xmx13g -Xmn800m -Xss128k -XX:MaxPermSize=512M -XX:+AggressiveHeap
-XX:+UseParallelGC -XX:ParallelGCThreads=4 -XX:MaxTenuringThreshold=3
-XX:SurvivorRatio=20 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps
-XX:-TraceClassUnloading -Dsun.net.inetaddr.ttl=1 -Dnetworkaddress.cache.ttl=1
-Dweblogic.SocketReaders=1 -Dweblogic.management.discover=false

Database SW Config
DB Product: Oracle Database Enterprise Edition Release 11.1.0.7
Hardware: Database Server HW
# of Instances: 1
Notes / Tuning Information 
db_name                 = spec04
compatible              = 11.1.0.1.0
control_files           = ?/dbs/cntrlspec04
aq_tm_processes         = 0
cursor_space_for_time   = TRUE
db_4k_cache_size        = 5000M
db_8k_cache_size        = 8000M
db_block_checking       = FALSE
db_block_checksum       = FALSE
db_block_size           = 2048
db_cache_advice         = OFF
db_cache_size           = 27000M
db_file_multiblock_read_count = 128
db_files                = 256
db_keep_cache_size      = 2200M
db_writer_processes     = 8
dml_locks               = 2200
fast_start_mttr_target  = 0
filesystemio_options    = DirectIO
log_buffer              = 67108864
log_checkpoint_interval = 0
log_checkpoints_to_alert= TRUE
open_cursors            = 2000
parallel_max_servers    = 100
pga_aggregate_target    = 0
processes               = 2000
query_rewrite_enabled   = FALSE
replication_dependency_tracking = FALSE
session_cached_cursors  = 2000
sessions                = 2205
shared_pool_size        = 4000M
statistics_level        = BASIC
timed_statistics        = FALSE
trace_enabled           = FALSE
transactions            = 2000
transactions_per_rollback_segment = 1
undo_management         = AUTO
undo_retention          = 300
undo_tablespace         = undo_ts
_array_update_vector_read_enabled = true
_collect_undo_stats     = FALSE
_db_cache_pre_warm      = FALSE
_db_writer_flush_imu    = FALSE
_diag_adr_enabled       = FALSE
_enable_obj_queues      = FALSE
_global_hang_analysis_interval_secs = 0
_hang_detection         = 0
_imu_pools              = 2000
_in_memory_undo         = TRUE
_ktc_control            = 4
_library_cache_advice   = FALSE
_local_hang_analysis_interval_secs = 0
_resource_manager_always_off = TRUE
_smm_advice_enabled     = FALSE
_two_pass               = FALSE
_undo_autotune          = FALSE

Driver SW Config Primary and Satellites
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_07
Hardware: Primary Driver HW
# of Instances: 3
Notes / Tuning Information 
-server -Xms2048M -Xmx2048M -XX:+DisableExplicitGC -XX:+UseParallelGC
-Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0

J2EE Application Server (SUT hardware)
Hardware Vendor: Dell OS Vendor: Oracle Corporation
Model Name: PowerEdge R610 OS Name: Oracle Enterprise Linux 5 Update 3 x86_64
Processor: Quad Core Intel(R) Xeon(R) X5570 Filesystem: ext3
MHz: 2933 Disks: 2x 73GB SAS 15K RPM
# of CPUs: 8 cores, 2 chips, 4 cores/chip, 2 threads/core (Hyper-Threading) Network Interface: 2x Quad Port Gigabit NIC, 1x Dual Port Gigabit NIC
Memory (MB): 24576 Other Hardware: See notes
L1 Cache: 32KB(I)+32KB(D) on chip per core # of Systems: 1
L2 Cache: 256KB on chip per core H/W Available: Mar-2009
Other Cache: 8MB(I+D) L3 on chip per chip OS Available: Jan-2009
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.file-max = 262144
kernel.sem = 250 32000 100 128
kernel.shmall = 268435456
kernel.shmmax = 4294967295
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000
vm.zone_reclaim_mode=1

For each of the NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso
bind interrupt to a core corresponding to the server instance

Server instances were started using numactl, binding 2 instances per chip.
Stop iptables.
Stop irqbalance.
Configure 10000 hugepages.

Other hardware:
1x BBWC Dell PERC6/e Integrated RAID Controller

Systems were configured with RAID 1 of the 2 disks using the integrated controller for OS,
JMS filestores and server logs.

Database Server HW (SUT hardware)
Hardware Vendor: Dell OS Vendor: Oracle Corporation
Model Name: PowerEdge R900 OS Name: Oracle Enterprise Linux 5 Update 2 x86_64
Processor: Six Core Intel(R) Xeon(R) X7460 Filesystem: ext3
MHz: 2666 Disks: 4x 73GB SAS 15K RPM
# of CPUs: 24 cores, 4 chips, 6 cores/chip Network Interface: 2x Dual Port Gigabit NIC
Memory (MB): 65536 Other Hardware: See notes
L1 Cache: 32KB(I)+32KB(D) on chip per core # of Systems: 1
L2 Cache: 9MB(I+D) on chip per chip, 3MB shared / 2 cores H/W Available: Sep-2008
Other Cache: 16MB(I+D) L3 on chip per chip OS Available: Jun-2008
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.aio-max-nr= 1048576
fs.file-max = 6553600
kernel.msgmni = 2878
kernel.sem = 250 32000 100 128
kernel.shmall = 4294967296
kernel.shmmax = 68719476736
net.core.netdev_max_backlog = 400000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 15000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_max_syn_backlog = 12000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000

For each of the 5 NICs used:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso

Stop iptables.
Stop irqbalance.
Configure 30000 hugepages.

Lgwr nice priority was set to -20
named nice priority was set to -10
Oracle shadow processes were bound to all cores in a round robin fashion.

Other hardware:
2x BBWC Dell PERC6/e SAS RAID Controller
3x (Dell MD1000 15-Bay Disk Enclosure with 14x 36GB 15K RPM SAS disks, configured as RAID)
Two RAID 10 under one controller were used for data files
One RAID 1 under separate controller was used for redo log files

Primary Driver HW (non-SUT hardware)
Hardware Vendor: Dell OS Vendor: Red Hat
Model Name: PowerEdge 6800 OS Name: Red Hat Enterprise Linux 5 Update 2 EM64T
Processor: Dual Core Intel(R) Xeon(R) 7041 Filesystem: ext3
MHz: 2993 Disks: 2x 73GB SCSI 15K RPM
# of CPUs: 8 cores, 4 chips, 2 cores/chip (HT) Network Interface: 2x Quad Port Gigabit NIC, 1x Dual Port Gigabit NIC
Memory (MB): 36864 Other Hardware:
L1 Cache: 12KB(I)+16KB(D) # of Systems: 1
L2 Cache: 2x2MB H/W Available: Mar-2007
Other Cache: OS Available: May-2008
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.file-max = 262144
kernel.sem = 250 32000 100 128
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000

For each of the 9 NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso

Stop iptables.

Satellite Driver #1 and #2 HW (non-SUT hardware)
Hardware Vendor: Dell OS Vendor: Red Hat
Model Name: PowerEdge 6850 OS Name: Red Hat Enterprise Linux 5 Update 1 EM64T
Processor: Dual Core Intel(R) Xeon(R) 7140 Filesystem: ext3
MHz: 3391 Disks: 2x 73GB SCSI 15K RPM
# of CPUs: 8 cores, 4 chips, 2 cores/chip Network Interface: 1x Quad Port Gigabit NIC, 3x Dual Port Gigabit NIC
Memory (MB): 32768 Other Hardware:
L1 Cache: 12KB(I)+16KB(D) # of Systems: 2
L2 Cache: 1MB H/W Available: Aug-2007
Other Cache: 16MB per chip L3 OS Available: Nov-2007
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.file-max = 262144
kernel.sem = 250 32000 100 128
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000

For each of the 9 NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso

Stop iptables.

Emulator HW (SUT hardware)
Hardware Vendor: Dell OS Vendor: Red Hat
Model Name: PowerEdge 6950 OS Name: Red Hat Enterprise Linux 5 Update 1 EM64T
Processor: Dual Core AMD(R) Processor 8212 Filesystem: ext3
MHz: 2000 Disks: 2 x 73GB SAS 15K RPM
# of CPUs: 8 cores, 4 chips, 2 cores/chip Network Interface: 1x Quad Port Gigabit NIC, 3x Dual Port Gigabit NIC
Memory (MB): 32768 Other Hardware: See notes
L1 Cache: 64KB(I)+64KB(D) # of Systems: 1
L2 Cache: 2MB per chip H/W Available: Apr-2007
Other Cache: OS Available: Nov-2007
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.file-max = 262144
kernel.sem = 250 32000 100 128
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000

Configure 9000 Huge Pages.
For each of the 9 NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso

Stop iptables.

Benchmark Modifications
Schema Modifications: 
  Tablespace sizes were increased to support the Injection rate. Table and index
  initrans were modified. The C_CUSTOMERINVENTORY, M_WORKORDER and O_ORDERLINE tables were
  horizontally partitioned. C_CUSTOMER, M_PARTS, M_BOM and M_INVENTORY were hash clustered.
  Table locks were disabled during the run for all the tables using ALTER TABLE DISABLE TABLE LOCK.
  Scripts to create the DB are included in the FDA.
Load Program Modifications: 
  The load program was not modified.

Benchmark Configuration Information
Isolation Requirement Info: 
  The following Beans were deployed in READ_COMMITTED mode as per the benchmark
  requirement:
  Mfg      - AssemblyEnt, BomEnt, ComponentEnt, LargeOrderEnt, PartEnt
  Orders   - ItemEnt
  Supplier - SupplierCompEnt, SupplierEnt
  
  All other beans were deployed using pessimistic locking mode such that all
  selects including finders are issued with a FOR UPDATE clause in select
  statement:
  Corp     - CustomerEnt, CustomerInventoryEnt
  Mfg      - InventoryEnt, WorkOrderEnt
  Orders   - OrderEnt, OrderLineEnt
  Supplier - POEnt, POLineEnt, SComponentEnt
  Util     - SequenceEnt
  
  The ItemEnt bean was cached for 20 minute intervals by setting
  the following in bea-orders.xml deployment descriptor:
  concurrency-strategy to ReadOnly
  read-timeout-seconds to 1200
Durability Requirement Info: 
  To ensure database durability, RAID 10 was used for the data files
  and RAID 1 for database redo logs.
  
  The application server used RAID 1 to provide durability for
  server logs and JMS persistence filestores.
  
  The RAID controller on the database and the application server machines were
  configured with Write-Back cache policy supported with battery backup unit on
  the controller.
Storage Requirement Info: 
  A 75 min run at Injection Rate of 2380 increased storage by 7.0 GB.
  Extrapolating for 24 hrs we need 134 GB. The system is configured with
  750GB of durable storage.
Argument Passing Semantics: 
  Oracle WebLogic Server Standard Edition uses pass-by-value as required by
  the EJB specification.

Bill of Materials 
Supplier  Description                                   SKU #              Qty
--------  -------------------------------------------   ----------------   ---
Dell      PowerEdge R610, QC Intel(r) Xeon(r) X5570     224-4229             1
          8MB Cache 2.93GHz, 1066MHz FSB
Dell      2 Quad Core Intel(r) Xeon(r) X5570,           317-1212             1
          8MB Cache, 2.93GHz, 1066MHZ FSB
Dell      PERC6/i Intergrated RAID controller           341-9254             1                 
Dell      24GB 1333MHz (6x4GB), Dual Ranked DIMMs       317-0236             1
Dell      73GB, SAS, 2.5-inch, 15K RPM Hard Drive       341-4727             2
Intel     Intel Pro 1000PT Quad Port Gigabit NIC        430-2688             2      
Dell      3Yr GOLD ENTERPRISE SUPPORT: 7x24 HW/SW,      984-1519,984-1528    1
          Escalation Mgmt 4hr 7x24 Onsite               310-3785,960-7532
                                                        960-7892,970-3620    

Dell      PowerEdge R900 6 Core Intel(R) Xeon(R) X7460  224-0676             1
          3x3MB Cache 2.66GHz, 1066MHz FSB
Dell      4x Six Core Intel(R) Xeon(R) X7460,           311-9170             1
          3x3MB Cache, 2.66GHz, 1066MHZ FSB      
Dell      64GB 667MHz (16x4GB), Dual Ranked DIMMs       311-7857             1
Dell      73GB, SAS, 3.5-inch, 15K RPM Hard Drive       341-4727             2
Dell      Intel Pro 1000PT Dual Port Gigabit NIC        313-4439             3 
Dell      3Yr GOLD ENTERPRISE SUPPORT: 7x24 HW/SW,      981-3170,981-3752    1
          Escalation Mgmt 4hr 7x24 Onsite               981-3652,981-3692 

Dell      PowerVault MD1000 15-Bay Disk Enclosure       222-2299             3
Dell      36GB,3GBps,SAS,3.5-inch,15K                   341-2818            42
Dell      PERC6/e SAS RAID Controller                   341-5851             2

Dell      PowerConnect 6248 Managed Switch, 48 Port     222-6714             1
          Gigabit Ethernet Switch with 4 SFP combo ports
Dell      3Yr GOLD Support, 4Hr Onsite                  983-3758,983-3837    1
          S/W Support, TAM Service                      960-1305,960-4492
                                                        960-9620
              
Oracle    Oracle Enterprise Linux Basic Support for 3 years                  2

Oracle    Oracle Database 11g Enterprise Edition, Per Processor    
          Unlimited Users for 3 years                                       12*
Oracle    Partitioning, Per Processor, Unlimited Users for 3 years          12* 
Oracle    Oracle Premium Support for 3 years                                 2

Oracle    Oracle WebLogic Server Standard Edition Release 10.3, 
          Per Processor for 3 years                                          4*
Oracle    Oracle Premium Support for 3 years                                 1
          

(* 12 = 0.50 * 24 and 4 = 0.50 * 8)  Explanation:  For the purposes of counting 
the number of processors which require licensing, an Intel multicore chip with "n" 
cores shall be determined by multiplying "n" cores by a factor of 0.50).

Other Benchmark Information 
  The xerces implementation version 2.6.2 from xml.apache.org was used as it comes
  packaged with Oracle Weblogic Server Standard Edition.
  
  Requests were directed to the Appserver instances using DNS round robin, with
  the database node acting as the DNS server.

General Notes 
On the database, incremental checkpointing ensured that no buffer will remain
dirty (in the cache) for more than the allowed time.

The only errors in the driver error logs are the application errors generated by
this benchmark.

For questions about this result, please contact the submitter: Oracle Corporation
For other inquiries, please contact webmaster@spec.org

Copyright © 2004 Standard Performance Evaluation Corporation

First published at SPEC.org on 30-Mar-2009