SPEC Seal of Reviewal SPECjAppServer®2004 Result
Copyright © 2004 Standard Performance Evaluation Corporation
Oracle WebLogic Server Standard Edition Release 10.3.3 on Sun SPARC Enterprise T5440
28,648.74 SPECjAppServer2004 JOPS@Standard
Submitter:
Oracle Corporation
SPEC license # 73 Test date:
May-2010
Software Products
Oracle WebLogic Server Standard Edition Release 10.3.3
Java HotSpot(TM) 32-Bit Server VM on Solaris, version 1.6.0_20
Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.6.0_20
Oracle JDBC Driver 11.1.0.7(Thin)
Oracle Database 11g Enterprise Edition Release 11.1.0.7
Software Configurations
J2EE Application Server
Emulator SW Config
Database SW Config
Driver SW Config - Primary & Satellites
Hardware Systems
J2EE AppServer HW
Database Server HW
Primary Load Driver and Satellites HW
Emulator HW
DNS Server

System Configuration Diagram

Benchmark
Modifications
Configuration
Bill of Materials
Other Info
General Notes
Full Disclosure Archive

SUT Configuration
J2EE Server Nodes: 5   DB Server Nodes: 1
J2EE Server CPUs: 160 cores, 20 chips   DB Server CPUs: 256 cores, 64 chips
J2EE Instances: 40   DB Instances: 1
Other SUT Components:
   

Benchmark Settings
Dealer Injection Rate: 17,250   Ramp Up Time: 600 seconds
# of Dealer Agents: 136   Ramp Down Time: 300 seconds
# of Manufacturing Agents: 100   Steady State Time: 3,600 seconds
DB Load Injection Rate: 20,000   Trigger Time: 3,300 seconds

Detailed Results
Dealer Transaction Mix Count Tx. Mix
Purchase 15,489,059 25.01%
Manage 15,478,583 24.99%
Browse 30,975,556 50.01%
Total # Dealer Transactions 61,943,198
Total # Manufacturing Transactions 41,192,251
Response Times Average Maximum 90th% Reqd
Purchase 0.54 41.36 1.40 2.00
Manage 0.49 39.23 1.00 2.00
Browse 0.64 41.23 2.00 2.00
Manufacturing 1.81 26.91 3.25 5.00
Reproducibility Run (SPECjAppServer2004 JOPS) 28,656.97

Oracle WebLogic Server Standard Edition Release 10.3.3
Vendor: Oracle Corporation Availability: Aug-2010
CTS Version: 5.0 Date Passed CTS: Feb-2007
OS Name: Solaris 10 10/09 64-bit
EJB Protocol: RMI/T3

Java HotSpot(TM) 32-Bit Server VM on Solaris, version 1.6.0_20
Vendor: Oracle Corporation Availability: Apr-2010
OS Name: Solaris 10 10/09 64-bit

Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.6.0_20
Vendor: Oracle Corporation Availability: Apr-2010
OS Name: Solaris 10 10/09 64-bit

Oracle JDBC Driver 11.1.0.7(Thin)
Vendor: Oracle Corporation Availability: Sep-2009
OS Name: Solaris 10 10/09 64-bit

Oracle Database 11g Enterprise Edition Release 11.1.0.7
Vendor: Oracle Corporation Availability: Sep-2009
OS Name: Solaris 10 10/09 64-bit

J2EE Application Server
J2EE Product: Oracle WebLogic Server Standard Edition Release 10.3.3
JVM Product: Java HotSpot(TM) 32-Bit Server VM on Solaris, version 1.6.0_20
JDBC Product: Oracle JDBC Driver 11.1.0.7(Thin)
Hardware: J2EE AppServer HW
# of Instances: 40
Interfaces:
Web Interface for the Dealer Domain
Web Interface for the Supplier Domain
EJB Interface for the Dealer Domain
EJB Interface for the Manufacturing Domain
EJB Interface for the Supplier Domain
Notes / Tuning Information
JVM Options:
 -server -Xms3300m -Xmx3300m -Xmn1024m -Xss128k -XX:+AggressiveOpts
 -XX:+UseParallelGC -XX:ParallelGCThreads=32 -XX:PermSize=128m
 -XX:LargePageSizeInBytes=4m -XX:+UseParallelOldGC
 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamp
 -XX:-UseAdaptiveSizePolicy -XX:+PrintAdaptiveSizePolicy
 -XX:MaxTenuringThreshold=15 -XX:InitialSurvivorRatio=10
 -XX:SurvivorRatio=10 -XX:TargetSurvivorRatio=90
 -XX:ReservedCodeCacheSize=64m -XX:CICompilerCount=4
 -Dweblogic.management.discover=false
 -Dweblogic.SocketReaders=4 -Dweblogic.StuckThreadMaxTime=900
 -Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true
 -Doracle.jdbc.defaultRowPrefetch=300
Java process started in FX class using /usr/bin/priocntl -e -c FX
Java process started with LD_PRELOAD_32=/usr/lib/libumem.so
Oracle patch for WebLogic Server Standard Edition 10.3.3: 9686209

Emulator SW Config
J2EE Product: Oracle WebLogic Server Standard Edition Release 10.3.3
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.6.0_20
Hardware: Emulator HW
# of Instances: 1
Notes / Tuning Information
JVM Options:
 -d64 -server -Xms20g -Xmx20g -Xmn3g -Xss256k -XX:+AggressiveOpts
 -XX:+UseParallelGC -XX:ParallelGCThreads=32 -XX:LargePageSizeInBytes=4m
 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps
 -XX:-TraceClassUnloading  -XX:PermSize=128m -XX:MaxPermSize=512M
 -XX:+UseCompressedOops -XX:TargetSurvivorRatio=90 -Dweblogic.SocketReaders=4
 -Dsun.net.inetaddr.ttl=1 -Dnetworkaddress.cache.ttl=1
Java process started in FX class using /usr/bin/priocntl -e -c FX
Java process started with LD_PRELOAD_64=/usr/lib/sparcv9/libumem.so

Database SW Config
DB Product: Oracle Database 11g Enterprise Edition Release 11.1.0.7
Hardware: Database Server HW
# of Instances: 1
Notes / Tuning Information
 db_name                         = spec
 control_files                   = ?/dbs/cntrlspec
 compatible                      = 11.1.0.6.0
 aq_tm_processes                 = 0
 cpu_count                       = 384
 db_4k_cache_size                = 48G
 db_8k_cache_size                = 30G
 db_block_checksum               = FALSE
 db_block_checking               = FALSE
 db_block_size                   = 2048
 db_cache_advice                 = OFF
 db_cache_size                   = 202207M
 db_file_multiblock_read_count   = 128
 db_files                        = 256
 db_keep_cache_size              = 5G
 db_recycle_cache_size           = 60G
 db_writer_processes             = 32
 disk_asynch_io                  = TRUE
 dml_locks                       = 1000
 filesystemio_options            = setall
 log_buffer                      = 201326592
 log_checkpoint_interval         = 0
 log_checkpoints_to_alert        = TRUE
 open_cursors                    = 2000
 parallel_max_servers            = 256
 processes                       = 12000
 query_rewrite_enabled           = FALSE
 replication_dependency_tracking = FALSE
 resource_manager_plan           = ''
 sessions                        = 25000
 shared_pool_size                = 24G
 statistics_level                = BASIC
 timed_statistics                = FALSE
 trace_enabled                   = FALSE
 transactions                    = 75000
 transactions_per_rollback_segment = 1
 undo_management                 = AUTO
 undo_retention                  = 300
 undo_tablespace                 = undo_ts

Oracle processes run in 16 processor sets using psrset -b pset PID.
and each process run in the FX class using /usr/bin/priocntl -s -c FX -i pid PID.
Oracle Log Writer run in a processor set containing 1 core.
using psrset -b pset pid and run in the RT class using
/usr/bin/priocntl -s -c RT -p 1 -i pid.
A separate processor set with 21 processors configured to process
interrupts from 20 network cards and the clock interrupt.
A processor set with 2 processors used to process interrupts
for the disk controllers configured for the redo logs.
The processor set configuration is in the FDA.
Oracle patches for 11.1.0.7: p7627743, p8570516.

Driver SW Config - Primary & Satellites
JVM Product: Java HotSpot(TM) 32-Bit Server VM on Solaris, version 1.6.0_20
Hardware: Primary Load Driver and Satellites HW
# of Instances: 10
Notes / Tuning Information
JVM Options:
 -server -XX:+AggressiveHeap -XX:+UseParallelGC
 -XX:LargePageSizeInBytes=4m -XX:-TraceClassUnloading
 -Xms2g -Xmx2g -Xmn600m -XX:+DisableExplicitGC -Xbatch
 -Xss128k -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0
 -Dweblogic.ThreadPoolSize=64 -Dweblogic.ThreadPoolPercentSocketReaders=80

J2EE AppServer HW (SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun SPARC Enterprise T5440 OS Name: Solaris 10 10/09 64-bit
Processor: Sun UltraSPARC T2 Plus Filesystem: UFS
MHz: 1596 Disks: 2x 73GB SAS Disks
# of CPUs: 32 cores, 4 chips, 8 cores/chip (8 threads/core) Network Interface: see notes
Memory (MB): 262144 Other Hardware: None
L1 Cache: 16KB(I)+8KB(D) per core # of Systems: 5
L2 Cache: 4MB per chip H/W Available: Jul-2009
Other Cache: None OS Available: Oct-2009
Notes / Tuning Information
System Tuning in /etc/system:
set ip:ip_soft_rings_cnt = 16
set ip:ip_squeue_fanout = 1

Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_time_wait_interval 10000
ndd -set /dev/tcp tcp_xmit_hiwat 524288
ndd -set /dev/tcp tcp_recv_hiwat 524288
ndd -set /dev/tcp tcp_smallest_anon_port 4096
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 10000

Tuning in /kernel/drv/ixgbe.conf:
tx_queue_number=12;
intr_throttling=2000;

Disk configuration:
2x 73GB SAS disks for OS and application software using UFS
SVM mirror using 2x SSD disks for logs and JMS persistence filestore.
Configuration notes:
Eight application server instances were hosted in 4 separate Solaris Containers.
The Four Containers were bound to separate processor sets where each pset
consisted of 56 HW threads (7 cores) using /usr/sbin/psrset -b PSET PID.
Interrupts were enabled on remaining HW strands in the default processor set.
The Solaris Container and Processor Set configuration is in the FDA.
Each Container on the system was connected to 2 subnets.
Four Containers shared one of two 10Gbit NICs.
Two Containers shared one of four 1 Gbit NICs.
The first subnet in each container was used for driver access using the 10 Gbit.
The second subnet in each container was used for database access
using the 1GBit NIC.

Database Server HW (SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun SPARC Enterprise M9000 OS Name: Solaris 10 10/09 64-bit
Processor: SPARC64 VII Filesystem: UFS
MHz: 2880 Disks: 4x 146Gb 10K RPM SAS
# of CPUs: 256 cores, 64 chips, 4 cores/chip (2 threads/core) Network Interface: see notes
Memory (MB): 2097152 Other Hardware: see notes
L1 Cache: 64KB(I)+64KB(D) per core # of Systems: 1
L2 Cache: 6MB per chip H/W Available: Jul-2008
Other Cache: None OS Available: Oct-2009
Notes / Tuning Information
System Tuning in /etc/system:
set kernel_cage_enable=0
set autoup 345600
set hires_tick = 1
set ip:ip_squeue_fanout = 1
set ip:ip_soft_rings_cnt = 8
set mmu_ism_pagesize = 0x10000000
set lgrp_mem_pset_aware=1
set lgrp_mem_default_policy=3
Disabled hardware prefetch by 'setprefetchmode -s off' command on XSCF

Interrupts from the Network and Disk controllers were configured
using the /usr/sbin/pcitool utility
Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_time_wait_interval 10000
ndd -set /dev/tcp tcp_xmit_hiwat 524288
ndd -set /dev/tcp tcp_recv_hiwat 524288
ndd -set /dev/tcp tcp_smallest_anon_port 4096
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 10000

Shared memory settings in /etc/project:
user.oracle:101:Oracle DBA:::project.max-shm-memory=(privileged,549755813888,deny)

Network configuration:
20x 1GBit NIC
1x 10GBit NIC

External Disk configuration:
6 Sun Storage F5100 microSSDArray (80 x 24GB Array)
24x DualPort SAS HBA
Solaris patch 141874-05

Primary Load Driver and Satellites HW (non-SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun Blade X6270 Server Module OS Name: Solaris 10 10/09 64-bit
Processor: Intel Xeon X5570 Filesystem: UFS
MHz: 2930 Disks: 2 x 146GB 15K RPM SAS
# of CPUs: 8 cores, 2 chips, 4 cores/chip (2 threads/core) Network Interface: see notes
Memory (MB): 49152 Other Hardware: None
L1 Cache: 32KB(I)+32KB(D) per core # of Systems: 10
L2 Cache: 256KB per core H/W Available: Apr-2009
Other Cache: 8 MB I+D L3 on chip per chip OS Available: Oct-2009
Notes / Tuning Information
System Tuning in /etc/system:
set ip:ip_soft_rings_cnt = 16

Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_xmit_hiwat 524288
ndd -set /dev/tcp tcp_recv_hiwat 524288
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_time_wait_interval 10000
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 10000
ndd -set /dev/tcp tcp_smallest_anon_port 4096

Blade Chassis Configuration:
1x Sun Blade 6000 Chassis each configured with
10x Sun Blade X6270 Server Modules and
10x Dual Port 10Gbit PCIe Express Modules

Emulator HW (non-SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun SPARC Enterprise M4000 OS Name: Solaris 10 10/09 64-bit
Processor: SPARC64 VII Filesystem: UFS
MHz: 2530 Disks: 2 x 146GB 10K RPM SAS
# of CPUs: 16 cores, 4 chips, 4 cores/chip, (2 threads/core) Network Interface: 1x 10Gbit NIC
Memory (MB): 65536 Other Hardware: None
L1 Cache: 64KB(I)+64KB(D) per core # of Systems: 1
L2 Cache: 5MB per chip H/W Available: Oct-2008
Other Cache: None OS Available: Oct-2009
Notes / Tuning Information
System Tuning in /etc/system:
set rlim_fd_cur=262144

Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_xmit_hiwat 524288
ndd -set /dev/tcp tcp_recv_hiwat 524288
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_time_wait_interval 10000
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 10000
ndd -set /dev/tcp tcp_smallest_anon_port 4096

DNS Server (SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun SPARC Enterprise M3000 OS Name: Solaris 10 10/09 64-bit
Processor: SPARC64 VII Filesystem: UFS
MHz: 2750 Disks: 2 x 146GB 10K RPM SAS
# of CPUs: 4 cores, 1 chip, 4 cores/chip, (2 threads/core) Network Interface: 1x 10Gbit NIC
Memory (MB): 8192 Other Hardware: None
L1 Cache: 64KB(I)+64KB(D) per core # of Systems: 1
L2 Cache: 5MB per chip H/W Available: Jan-2010
Other Cache: None OS Available: Oct-2009
Notes / Tuning Information
Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 16384
ndd -set /dev/tcp tcp_conn_req_max_q0 16384
ndd -set /dev/tcp tcp_xmit_hiwat 131072
ndd -set /dev/tcp tcp_recv_hiwat 131072
ndd -set /dev/tcp tcp_naglim_def 1
The DNS named process run in the RT class using /usr/bin/priocntl -s -c RT -p 1 -i pid PID

Benchmark Modifications
Schema Modifications:
  Tablespace sizes were increased to support the Injection rate.
  Scripts to create the DB are included in the FDA.
  Table and index initrans were modified.
  The following tables were horizontally partitioned:
  C_CUSTOMER, C_CUSTOMERINVENTORY, M_LARGEORDER, M_WORKORDER, O_ORDERLINE,
  O_ORDERS, S_COMPONENT, S_PURCHASEORDER, S_PURCHASEORDERLINE and S_SUPP_COMPONENT.
  The M_PARTS, M_BOM, M_INVENTORY, and O_ITEM tables were hash clustered.
  Automatic segment space management was used for all tablespaces.
  System managed undo was used.
  Table locks were disabled during the run using disable_locks.sh script.
  
Load Program Modifications:
  The load program was not modified

Benchmark Configuration Information
Isolation Requirement Info:
  The following Beans were deployed in READ_COMMITTED mode as per the
  benchmark requirement:
  Mfg      - AssemblyEnt, BomEnt, ComponentEnt, LargeOrderEnt, PartEnt
  Orders   - ItemEnt
  Supplier - SupplierCompEnt, SupplierEnt
  
  All other beans were deployed using pessimistic locking mode such that all
  selects including finders are issued with a FOR UPDATE clause in select
  statement:
  Corp     - CustomerEnt, CustomerInventoryEnt
  Mfg      - InventoryEnt, WorkOrderEnt
  Orders   - OrderEnt, OrderLineEnt
  Supplier - POEnt, POLineEnt, SComponentEnt
  Util     - SequenceEnt
  
  The ItemEnt bean was cached for 20 minute intervals by setting:
  concurrency-strategy to ReadOnly and
  read-timeout-seconds to 1200
  in bea-orders.xml deployment descriptor.
  
Durability Requirement Info:
  To ensure database durability, RAID 1 was used for the
  database files and database redo logs maintained
  on the Sun F5100 Storage Arrays.
  
  The application servers used a pair of internal SSD disks
  using an SVM mirror to provide durability for the
  server logs and JMS persistence filestore.
Storage Requirement Info:
  A 75 minute run at an injection rate of 17250 increased storage by 50 GB
  This extrapolates to 952 GB storage for a 24 hour run.
  The database was configured with 5.6TB of storage.
  
  Two Sun Storage F5100 arrays were configured each
  with 1.9TB for the database redo logs.
Argument Passing Semantics:
  Oracle WebLogic Server 10.3.3 uses pass-by-value as required by the EJB Specification

Bill of Materials

Supplier  Description                                  Product No.          Qty
--------  ------------------------------------------   ------------------   ---
Oracle    SPARC Enterprise T5440 Server 4RU Chassis    SEVASY12Z-N           5
Oracle    T5440 CPU module 1.6 GHz, 16GB memory        SEVY1EC2Z-N          20
Oracle    8GB Memory Expansion Kit                     SESY2C4Z-N          120
Oracle    Dual 10GbE XFP SR PCI Express card           X1107A-Z-N           10
Oracle    PCI-E Quad port GigE                         4447A-Z-N             5
Oracle    146GB 10K SAS disk                           SEMY3B11Z-N          10
Oracle    32GB SATA SSD                                SEVY3Y11Z-N          10
Oracle    DVD R/W 8x                                   SEVY9DV1U             5
Oracle	  Localized power cord	                       X311L-N              20
Oracle    Solaris 10 10/09 Media Kit                   SOLZS-10LC9A7M        1
Oracle    Oracle Premier Support for Systems 3 years   Q-PREM-SPRT-SYS       5

Oracle    SPARC Enterprise M9000-64 Base 	       SEJASY31Z-N	     1
Oracle    SE_CMU:4*SPARC64VII 2.88w/128G	       SEMY4HG1Z-N          16
Oracle    SE_PCI-E IO Unit for Enterprise Server       SEMY61Z-N	    16
Oracle    SE_PCI-E Base IO card			       SEMY7BS1Z-N          21
Oracle    146GB 10K SAS disk                           SEMY3B11Z-N           4
Oracle    Dual Port SAS HBA                            SG-PCIE8SAS-E-Z-N    24
Oracle    PCI-E Dual 10GigE Fiber XFP Adapter          X1027A-Z-N            1
Oracle    XFP SR Transceiver                           X5558A-N              1
Oracle    SE_146GB 10K RPM 2.5inch SAS		       SEMY3B11Z-N           4
Oracle    Power Cords				       SEMY9P31Z-N          10
Oracle    Oracle Premier Support for Systems 3 years   Q-PREM-SPRT-SYS       1

Oracle    SPARC Enterprise M3000, 2.75GHz, 1P          SEWPCBA1Z-N           1
Oracle    PCI-E Dual 10GigE Fiber XFP Adapter          X1027A-Z-N            1
Oracle    XFP SR Transceiver                           X5558A-N              1
Oracle    Oracle Premier Support for Systems 3 years   Q-PREM-SPRT-SYS       1

Oracle    Sun Storage F5100                            TA5100RASA4-80AA-N    6
Oracle	  Localized power cord	                       X311L-N              12
Oracle    Oracle Premier Support for Systems 3 years   Q-PREM-SPRT-SYS       6

Oracle    17" Entry Color Monitor                      X7204A-N              1
Oracle    XVR-300 Graphics Accelerator                 X3000A-N              1
Oracle    USB Keyboard & Mouse                         320-1366-N            1
Oracle    Oracle Premier Support for Systems 3 years   Q-PREM-SPRT-SYS       1

Oracle    Oracle Database 11g Enterprise Edition, Per Processor,           192**
          Unlimited users for 3 years
Oracle    Partitioning, Per Processor,  Unlimited users for 3 years        192**
Oracle    Oracle Premium Support for 3 years                                 2

Oracle    Oracle WebLogic Server Standard Edition Release 10.3.3,           80*
          Per Processor for 3 years
Oracle    Oracle Premium Support for 3 years                                 1     

(** 192 = 0.75 * 256).  Explanation:  For the purposes of counting the number
of processors which require licensing, a multicore chip with "n" cores shall
be determined by multiplying "n" cores by a factor of .75).

(* 80 = 0.5 * 160).  Explanation:  For the purposes of counting the number
of processors which require licensing, a multicore chip with "n" cores shall
be determined by multiplying "n" cores by a factor of .5).



Other Benchmark Information
  This submission used the xerces implementation 2.8.1 provided
  with Oracle WebLogic 10.3.3.
  
  Requests were sent to the Appservers using DNS round robin.
  

General Notes
The only errors in the driver log files were those that are normally
generated by this benchmark.

On the database, incremental checkpointing ensured that no buffer will
remain dirty (in the cache) for more than the allowed time.



For questions about this result, please contact the submitter: Oracle Corporation
For other inquiries, please contact webmaster@spec.org

Copyright © 2004 Standard Performance Evaluation Corporation

First published at SPEC.org on 03-Jun-2010