SPEC Seal of Reviewal SPECjAppServer®2004 Result
Copyright © 2004 Standard Performance Evaluation Corporation
Oracle WebLogic Server Standard Edition Release 10.3 on Sun SPARC Enterprise T5140
9,500.76 SPECjAppServer2004 JOPS@Standard
Submitter:
Sun Microsystems Inc.
SPEC license # 6 Test date:
Jan-2009
Software Products
Oracle WebLogic Server Standard Edition Release 10.3 with patch for CR383871
Java HotSpot(TM) 32-Bit Server VM on Solaris, version 1.6.0_06 Performance Release
Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.6.0_06 Performance Release
Oracle JDBC Driver 11.1.0.7(Thin)
Oracle Database Enterprise Edition Release 11.1.0.7
Software Configurations
J2EE Application Server
Emulator SW Config
Database SW Config
Driver SW Config - Primary & Satellites
Hardware Systems
J2EE AppServer HW
Database Server HW
Load Driver
Emulator
DNS Server

System Configuration Diagram

Benchmark
Modifications
Configuration
Bill of Materials
Other Info
General Notes
Full Disclosure Archive

SUT Configuration
J2EE Server Nodes: 4   DB Server Nodes: 1
J2EE Server CPUs: 64 cores, 8 chips   DB Server CPUs: 32 cores, 4 chips
J2EE Instances: 16   DB Instances: 1
Other SUT Components:
   

Benchmark Settings
Dealer Injection Rate: 5,700   Ramp Up Time: 600 seconds
# of Dealer Agents: 70   Ramp Down Time: 300 seconds
# of Manufacturing Agents: 30   Steady State Time: 3,600 seconds
DB Load Injection Rate: 6,000   Trigger Time: 1,900 seconds

Detailed Results
Dealer Transaction Mix Count Tx. Mix
Purchase 5,136,970 25.01%
Manage 5,136,197 25.00%
Browse 10,269,495 49.99%
Total # Dealer Transactions 20,542,662
Total # Manufacturing Transactions 13,660,075
Response Times Average Maximum 90th% Reqd
Purchase 0.39 72.78 0.70 2.00
Manage 0.41 74.80 0.80 2.00
Browse 0.46 73.47 0.90 2.00
Manufacturing 1.86 75.08 3.00 5.00
Reproducibility Run (SPECjAppServer2004 JOPS) 9,506.00

Oracle WebLogic Server Standard Edition Release 10.3 with patch for CR383871
Vendor: Oracle Corporation Availability: Mar-2009
CTS Version: 5.0 Date Passed CTS: Feb-2007
OS Name: Solaris 10 10/08 64-bit
EJB Protocol: RMI/T3

Java HotSpot(TM) 32-Bit Server VM on Solaris, version 1.6.0_06 Performance Release
Vendor: Sun Microsystems, Inc. Availability: Jul-2008
OS Name: Solaris 10 10/08 64-bit

Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.6.0_06 Performance Release
Vendor: Sun Microsystems, Inc. Availability: Jul-2008
OS Name: Solaris 10 10/08 64-bit

Oracle JDBC Driver 11.1.0.7(Thin)
Vendor: Oracle Corporation Availability: Dec-2008
OS Name: Solaris 10 10/08 64-bit

Oracle Database Enterprise Edition Release 11.1.0.7
Vendor: Oracle Corporation Availability: Dec-2008
OS Name: Solaris 10 10/08 64-bit

J2EE Application Server
J2EE Product: Oracle WebLogic Server Standard Edition Release 10.3 with patch for CR383871
JVM Product: Java HotSpot(TM) 32-Bit Server VM on Solaris, version 1.6.0_06 Performance Release
JDBC Product: Oracle JDBC Driver 11.1.0.7(Thin)
Hardware: J2EE AppServer HW
# of Instances: 16
Interfaces:
Web Interface for the Dealer Domain
Web Interface for the Supplier Domain
EJB Interface for the Dealer Domain
EJB Interface for the Manufacturing Domain
EJB Interface for the Supplier Domain
Notes / Tuning Information
JVM Options:
 -server -Xms3g -Xmx3g -Xmn1g -Xss128k -XX:+AggressiveHeap
 -XX:+UseParallelGC -XX:ParallelGCThreads=8 -XX:PermSize=128m
 -XX:LargePageSizeInBytes=4m -XX:+UseParallelOldGC
 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamp
WLS Options:
 -Dweblogic.SocketReaders=4 -Dweblogic.StuckThreadMaxTime=1200
 -Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true
Java process started in FX class using /usr/bin/priocntl -e -c FX
Java process started with LD_PRELOAD_32=/usr/lib/libumem.so

Emulator SW Config
J2EE Product: Oracle WebLogic Server Standard Edition Release 10.3 with patch for CR383871
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.6.0_06 Performance Release
Hardware: Emulator
# of Instances: 1
Notes / Tuning Information
JVM Options:
 -d64 server -Xms16g -Xmx16g -Xmn12g -Xss256k -XX:+AggressiveHeap
 -XX:+UseParallelGC -XX:ParallelGCThreads=32
 -XX:LargePageSizeInBytes=4m -XX:MaxTenuringThreshold=3
 -XX:SurvivorRatio=20 -verbose:gc -XX:+PrintGCDetails
 -XX:+PrintGCTimeStamps -XX:-TraceClassUnloading
 -XX:PermSize=96m -XX:MaxPermSize=512M -XX:+UseCompressedOops
WLS Options:
 -Dweblogic.SocketReaders=4 -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0
Java process started in FX class using /usr/bin/priocntl -e -c FX
Java process started with LD_PRELOAD_64=/usr/lib/sparc64/libumem.so

Database SW Config
DB Product: Oracle Database Enterprise Edition Release 11.1.0.7
Hardware: Database Server HW
# of Instances: 1
Notes / Tuning Information
 db_name                         = specdb
 control_files                   = /specdb/cntrlspecdb
 _db_writer_flush_imu            = FALSE
 _db_cache_pre_warm              = FALSE
 _collect_undo_stats             = FALSE
 _imu_pools                      = 2000
 _in_memory_undo                 = true
 _smm_advice_enabled             = FALSE
 _undo_autotune                  = FALSE
 _ksmg_granule_size              = 33554432
 compatible                      = 11.1.0.6.0
 cursor_space_for_time           = TRUE
 aq_tm_processes                 = 0
 db_cache_size                   = 50G
 db_cache_advice                 = off
 db_8k_cache_size                = 12G
 db_4k_cache_size                = 10G
 db_keep_cache_size              = 4096M
 db_block_size                   = 2048
 db_block_checksum               = FALSE
 db_block_checking               = FALSE
 db_file_multiblock_read_count   = 128
 db_files                        = 256
 db_writer_processes             = 8
 dml_locks                       = 1000
 disk_asynch_io                  = TRUE
 log_buffer                      = 100663296
 log_checkpoint_interval         = 0
 log_checkpoints_to_alert        = TRUE
 open_cursors                    = 2000
 parallel_max_servers            = 100
 processes                       = 3300
 query_rewrite_enabled           = false
 replication_dependency_tracking = false
 sessions                        = 3300
 shared_pool_size                = 8G
 statistics_level                = BASIC
 timed_statistics                = false
 trace_enabled                   = FALSE
 transactions                    = 33000
 transactions_per_rollback_segment = 1
 undo_management                 = AUTO
 undo_retention                  = 300
 undo_tablespace                 = undo_ts
 cpu_count                       = 216
 _array_update_vector_read_enabled = true
 _diag_adr_enabled               = false
 _fg_sync_sleep_usecs            = 3000
 _global_hang_analysis_interval  = 0
 _hang_detection                 = 0
 _ktc_control                    = 4
 _library_cache_advice           = false
 _local_hang_analysis_interval_secs = 0
 _global_hang_analysis_interval_secs = 0
 _resource_manager_always_off    = true
 _two_pass                       = false
 _log_event_queues               = 4

Oracle processes run in 4 processor sets containing 28 cores in all, using psrset -b pset pid
and each process run in the FX class using /usr/bin/priocntl -s -c FX -i pid
Oracle Log Writer run in a processor set containing 4 HW strands
using psrset -b pset pid and run in the RT class using
/usr/bin/priocntl -s -c RT -p 1 -i pid.
One processor set configured with 3 HW strands executing the OS clock
thread (HW strand 0) and the 2 e1000g interrupt threads.
The remaining cores were used for network and disk interrupt handling.
Four ST2540 and ST2501 storage array pairs configured as one ASM diskgroup for
the database files. Two ST2540 storage arrays configured with three ASM diskgroups
for the redo logs. The ASM configuration is in the FDA.

Driver SW Config - Primary & Satellites
JVM Product: Java HotSpot(TM) 32-Bit Server VM on Solaris, version 1.6.0_06 Performance Release
Hardware: Load Driver
# of Instances: 9
Notes / Tuning Information
JVM Options:
 -server -XX:+AggressiveHeap -XX:+UseParallelGC
 -XX:LargePageSizeInBytes=4m -XX:-TraceClassUnloading
 -Xms2g -Xmx2g -Xmn600m -XX:+DisableExplicitGC -Xbatch
 -Xss128k -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0
 -Dweblogic.ThreadPoolSize=50 -Dweblogic.ThreadPoolPercentSocketReaders=50

J2EE AppServer HW (SUT hardware)
Hardware Vendor: Sun Microsystems, Inc. OS Vendor: Sun Microsystems, Inc.
Model Name: Sun SPARC Enterprise T5140 OS Name: Solaris 10 10/08 64-bit
Processor: Sun UltraSPARC T2 Plus Filesystem: see notes
MHz: 1165 Disks: see notes
# of CPUs: 16 cores, 2 chips, 8 cores/chip (8 threads/core) Network Interface: see notes
Memory (MB): 32768 Other Hardware:
L1 Cache: 16KB(I)+8KB(D) per core # of Systems: 4
L2 Cache: 4MB per chip H/W Available: Feb-2009
Other Cache: OS Available: Oct-2008
Notes / Tuning Information
System Tuning in /etc/system:
set ip:ip_soft_rings_cnt = 16
Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 16384
ndd -set /dev/tcp tcp_conn_req_max_q0 16384
ndd -set /dev/tcp tcp_xmit_hiwat 131072
ndd -set /dev/tcp tcp_recv_hiwat 131072
ndd -set /dev/tcp tcp_naglim_def 1
Network configuration:
1x XAUI 10Gbit NIC, 1x onboard 1Gbit NIC
Disk and File system configuration:
2x 146GB SAS disks for OS and application software using UFS.
2x 32GB SSD disks for logs and JMS persistence filestore using ZFS.
Configuration notes:
Four application server instances were hosted in 4 separate Solaris Containers.
Three Containers were bound to separate processor sets where each pset
consisted of 4 cores (32 HW threads) using resource pools.
The fourth container used the default processor set.
The Solaris Container and Resouce Pool configuration is in the FDA.
Interrupts were enabled on one HW strand per core.
Each Container on the system was connected to 2 subnets.
The first subnet in each container was used for driver access and
connected to the 10 GbE switch.
All 4 containers shared one 10Gbit NIC for this subnet
The second subnet in each container was used for database access
where all 4 containers shared a 1GBit NIC for this subnet.

Database Server HW (SUT hardware)
Hardware Vendor: Sun Microsystems, Inc. OS Vendor: Sun Microsystems, Inc.
Model Name: Sun SPARC Enterprise T5440 OS Name: Solaris 10 10/08 64-bit
Processor: Sun UltraSPARC T2 Plus Filesystem: UFS
MHz: 1414 Disks: 2x146Gb 10K RPM SAS
# of CPUs: 32 cores, 4 chips, 8 cores/chip (8 threads/core) Network Interface: see notes
Memory (MB): 262144 Other Hardware: see notes
L1 Cache: 16KB(I)+8KB(D) per core # of Systems: 1
L2 Cache: 4MB per chip H/W Available: Oct-2008
Other Cache: OS Available: Oct-2008
Notes / Tuning Information
System Tuning in /etc/system:
set kernel_cage_enable=0
set ip:ip_soft_rings_cnt = 8
set hires_tick = 1
Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 16384
ndd -set /dev/tcp tcp_conn_req_max_q0 16384
ndd -set /dev/tcp tcp_xmit_hiwat 131072
ndd -set /dev/tcp tcp_recv_hiwat 131072
ndd -set /dev/tcp tcp_naglim_def 1
Shared memory settings in /etc/project:
user.oracle:101:Oracle DBA:::project.max-shm-memory=(privileged,137438953472,deny)
Network configuration
1x 10 GbE XAUI card, 2x 1GBit oboard NIC, and 1x Dual Port 1Gbit NIC
Disk configuration
3x 4Gb Dual Port PCI-E Fiber Channel card
6 Sun StorageTek 2540 Array (12 x 146GB SAS Array)
4 Sun StorageTek 2501 Expansion Array (12 x 146GB SAS Array)
The Processor Set configuration is in the FDA.

Load Driver (non-SUT hardware)
Hardware Vendor: Sun Microsystems, Inc. OS Vendor: Sun Microsystems, Inc.
Model Name: Sun Blade T6300 Server Module OS Name: Solaris 10 8/07 64-bit
Processor: UltraSPARC T1 Filesystem: UFS
MHz: 1400 Disks: 2 x 73GB 10K RPM SAS
# of CPUs: 8 cores, 1 chip, 8 cores/chip (4 threads/core) Network Interface: see notes
Memory (MB): 32768 Other Hardware:
L1 Cache: 16KB(I)+8KB(D) per core # of Systems: 10
L2 Cache: 3MB per chip H/W Available: Jun-2007
Other Cache: OS Available: Sep-2007
Notes / Tuning Information
System Tuning in /etc/system:
set ip:ip_soft_rings_cnt = 16
Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 16384
ndd -set /dev/tcp tcp_conn_req_max_q0 16384
ndd -set /dev/tcp tcp_xmit_hiwat 131072
ndd -set /dev/tcp tcp_recv_hiwat 131072
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_time_wait_interval 10000
Blade Chassis Configuration:
Sun Blade 6000 Chassis configured with
10 Sun Blade T6300 Server Modules and
10 10Gbit PCIe Express Modules

Emulator (non-SUT hardware)
Hardware Vendor: Sun Microsystems, Inc. OS Vendor: Sun Microsystems, Inc.
Model Name: Sun SPARC Enterprise M3000 OS Name: Solaris 10 10/08 64-bit
Processor: SPARC64 VII Filesystem: UFS
MHz: 2520 Disks: 2 x 146GB 10K RPM SAS
# of CPUs: 4 cores, 1 chip, 4 cores/chip Network Interface: 1x 10Gbit NIC
Memory (MB): 32768 Other Hardware:
L1 Cache: 64KB(I)+64KB(D) per core # of Systems: 1
L2 Cache: 5MB per chip H/W Available: Oct-2008
Other Cache: OS Available: Oct-2008
Notes / Tuning Information
Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 16384
ndd -set /dev/tcp tcp_conn_req_max_q0 16384
ndd -set /dev/tcp tcp_xmit_hiwat 131072
ndd -set /dev/tcp tcp_recv_hiwat 131072
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_time_wait_interval 10000

DNS Server (SUT hardware)
Hardware Vendor: Sun Microsystems, Inc. OS Vendor: Sun Microsystems, Inc.
Model Name: Sun SPARC Enterprise M3000 OS Name: Solaris 10 10/08 64-bit
Processor: SPARC64 VII Filesystem: UFS
MHz: 2520 Disks: 2 x 146GB 10K RPM SAS
# of CPUs: 4 cores, 1 chip, 4 cores/chip Network Interface: 1x 10Gbit NIC
Memory (MB): 32768 Other Hardware:
L1 Cache: 64KB(I)+64KB(D) per core # of Systems: 1
L2 Cache: 5MB per chip H/W Available: Oct-2008
Other Cache: OS Available: Oct-2008
Notes / Tuning Information
Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 16384
ndd -set /dev/tcp tcp_conn_req_max_q0 16384
ndd -set /dev/tcp tcp_xmit_hiwat 131072
ndd -set /dev/tcp tcp_recv_hiwat 131072
ndd -set /dev/tcp tcp_naglim_def 1
The DNS named process run in the RT class using /usr/bin/priocntl -s -c RT -p 1 -i pid PID

Benchmark Modifications
Schema Modifications:
  Tablespace sizes were increased to support the Injection rate.
  Scripts to create the DB are included in the FDA.
  Table and index initrans were modified.
  The following tables were horizontally partitioned:
  C_customerinventory, C_customer, M_workorder, M_inventory,
  O_orders, O_orderline, S_component, and S_purchase_orderline.
  The M_parts and M_bom tables were hash clustered.
  Automatic segment space management was used for all tablespaces.
  System managed undo was used.
  Table locks were disabled during the run using disable_locks.sh script.
  
Load Program Modifications:
  The load program was not modified

Benchmark Configuration Information
Isolation Requirement Info:
  The following Beans were deployed in READ_COMMITTED mode as per the
  benchmark requirement:
  Mfg      - AssemblyEnt, BomEnt, ComponentEnt, LargeOrderEnt, PartEnt
  Orders   - ItemEnt
  Supplier - SupplierCompEnt, SupplierEnt
  
  All other beans were deployed using pessimistic locking mode such that all
  selects including finders are issued with a FOR UPDATE clause in select
  statement:
  Corp     - CustomerEnt, CustomerInventoryEnt
  Mfg      - InventoryEnt, WorkOrderEnt
  Orders   - OrderEnt, OrderLineEnt
  Supplier - POEnt, POLineEnt, SComponentEnt
  Util     - SequenceEnt
  
  The ItemEnt bean was cached for 20 minute intervals by setting:
  concurrency-strategy to ReadOnly and
  read-timeout-seconds to 1200
  in bea-orders.xml deployment descriptor.
  
Durability Requirement Info:
  To ensure database durability, RAID 1 (mirror disks)
  was used for the database files and logs maintained
  on the StorageTek ST2540 & 2501 Storage Arrays.
  
  Each application server used a pair of internal SSD disks
  using a ZFS mirror to provide durability for the
  server logs and JMS persistence filestore.
Storage Requirement Info:
  A 75 minute run at an injection rate of 5700 increased storage by 6310 MB
  This extrapolates to 121 GB storage for a 24 hour run.
  The database was configured with 17TB of storage.
  
  Four sets of Sun StorageTek 2540/2501 daisy-chained pairs were configured
  as 8 RAID 1 logical drives for the database files.
  Two Sun StorageTek 2540 FC Arrays (12 x 146GB) where configured
  as 2 RAID 1 logical drives to store the database redo logs.
Argument Passing Semantics:
  Oracle WebLogic Server 10.3 uses pass-by-value as required by the EJB Specification

Bill of Materials

Supplier  Description                                  Product No.          Qty
--------  ------------------------------------------   ------------------   ---
Sun       SPARC Enterprise T5140, 1.2GHz, 2x 8-core    SETPCJE3Z	     4
Sun	  10 GbE XAUI card - Fiber		       SESX7XA1Z	     4
Sun	  Transceiver for XAUI - 10GbE SR XFP	       SESX7XT1Z	     4
Sun	  32GB SATA SSD				       SESX3Y11Z	     8
Sun       Solaris 10 10/08		               SESY9SD1Z	     1
Sun       In-Warranty Upgrade: 3YGOLD, 24x7            IWU-T5140-8-24-3G     4

Sun       SPARC Enterprise T5440, 1.4GHz, 4x 8-core    SEVPHSF1Z	     1
Sun	  8GB Memory Expansion Kit		       SESX2C1Z             16
Sun	  10 GbE XAUI card - Fiber		       SESX7XA1Z	     1
Sun	  Transceiver for XAUI - 10GbE SR XFP	       SESX7XT1Z	     1
Sun	  Dual Port GiGE UTP			       X7280A-2		     1
Sun	  4 Gb PCI-E Dual Port FC/AL card	       SG-XPCIE2FC-EM4	     3
Sun       In-Warranty Upgrade: 3YGOLD, 24x7            IWU-T5440-4P-24-3G    1

Sun	  SPARC Enterprise M3000, 2.52GHz, 1P	       SEWPACA1Z	     1
Sun	  SPARC Enterprise M3000, 4x4GB DIMM	       SEWX2C1Z		     1
Sun 	  PCI-E Dual 10GigE Fiber XFP Adapter	       X1027A-Z		     1
Sun	  XFP SR Transceiver			       X5558A                1
Sun	  In-Warranty Upgrade: 3YGOLD, 24x7	       IWU-M3K1-24-3G	     1

Sun	  Sun StorageTek 2540, 12 x 146GB, 2 RAID      XTA2540R01D2E1752     6
Sun	  Sun StorageTek 2501, 12 x 146GB, EXP Array   XTA2501R01D2E1752     4
Sun	  SunSpectum Upgrade: 3Y GOLD, 24x7	       IWU-ST2540NW-24-3G    6
Sun	  SunSpectum Upgrade: 3Y GOLD, 24x7	       IWU-ST2501NW-24-3G    4

Sun       17" Entry Color Monitor                      X7204A                1
Sun       XVR-300 Graphics Accelerator                 X3000A                1
Sun       USB Keyboard & Mouse                         320-1366              1

Oracle    Oracle Database 11g Release 1 Enterprise Edition, Per Processor    24**
          (v11.1.0.7)                                                               
Oracle    Partitioning, Per Processor,  Unlimited users for 3 years          24**       
Oracle    Oracle Premium Support for 3 years                                 2                              

Oracle    Oracle WebLogic Server Standard Edition, 10.3                      48***
Oracle    Oracle Premium Support for 3 years                                 1     

(**  24 = 0.75 * 32).  Explanation:  For the purposes of counting the number of 
processors which require licensing, a multicore chip with "n" cores shall be 
determined by multiplying "n" cores by a factor of .75).

(***  48 = 0.75 * 64).  Explanation:  For the purposes of counting the number of 
processors which require licensing, a multicore chip with "n" cores shall be 
determined by multiplying "n" cores by a factor of .75).



Other Benchmark Information
  This submission used the xerces implementation 2.8.1 provided
  with Oracle WebLogic 10.3.
  
  Requests were sent to the Appservers using DNS round robin.
  

General Notes
The only errors in the driver log files were those that are normally
generated by this benchmark.

On the database, incremental checkpointing ensured that no buffer will
remain dirty (in the cache) for more than the allowed time.

10 GbE Switch Details:
3x Foundry EdgeIron 8-port 10GbE Switch - Product No. EIF8X10G
24x 10GbE XFP Transceivers - Product No. 10G-XFP-SR

SPARC Enterprise T5440 and Sun SPARC Enterprise M3000.
The Fujitsu SPARC Enterprise T5140 and Sun SPARC Enterprise T5140
are electronically equivalent.
The Fujitsu SPARC Enterprise T5440 and Sun SPARC Enterprise T5440
are electronically equivalent.
The Fujitsu SPARC Enterprise M3000 and Sun SPARC Enterprise M3000
are electronically equivalent.


For questions about this result, please contact the submitter: Sun Microsystems Inc.
For other inquiries, please contact webmaster@spec.org

Copyright © 2004 Standard Performance Evaluation Corporation

First published at SPEC.org on 04-Feb-2009