SPEC Seal of Reviewal SPECjEnterprise®2010 Result
Copyright © 2009-2013 Standard Performance Evaluation Corporation
Oracle Weblogic Server Standard Edition Release 12.1.1 on Oracle SPARC T5-8
57,422.17 SPECjEnterprise2010 EjOPS
Submitter:
Oracle Corporation
SPEC license # 73 Test date:
Mar-2013
Software Products
Oracle WebLogic Server Standard Edition Release 12.1.1
Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_15
Oracle JDBC Driver 11.2.0.3(Thin)
Oracle Database 11g Enterprise Edition Release 11.2.0.3
Software Configurations
JEE Application Server
Emulator Software Config
Database Software Config
Driver Software Config
Hardware Systems
JEE AppServer HW
Database Server HW
Load Driver & Emulator HW

System Configuration Diagram

Benchmark
Modifications
Configuration
Bill of Materials
Other Info
General Notes
Full Disclosure Archive

SUT Configuration
JEE Server Nodes: 1   DB Server Nodes: 1
JEE Server CPUs: 128 cores, 8 chips   DB Server CPUs: 128 cores, 8 chips
JEE Instances: 16   DB Instances: 1
Other SUT Components:
    None

Benchmark Settings
Dealer Injection Rate: 36,000   Ramp Up Time: 900 seconds
DB Load Injection Rate: 40,000   Steady State Time: 3,600 seconds
# of Dealer Agents: 360,000   Ramp Down Time: 300 seconds
# of Manufacturing Agents: 108,000  

Detailed Results
Dealer Transaction Mix Count Tx. Mix Failure Count
Purchase 32,569,454 25.00% 8
Manage 32,569,721 25.00% 19
Browse 65,147,366 50.00% 0
Total # Dealer Transactions 130,286,541
Manufacturing Transaction Mix Count Tx. Mix Failure Count
CreateVehicleEJB 38,224,486 50.01% 6,963
CreateVehicleWS 38,208,777 49.99% 6,831
Total # Manufacturing Transactions 76,433,263
Response Times Average Standard Deviation Maximum 90th% Reqd
Purchase 0.207 0.54 13.974 0.370 2.000
Manage 0.128 0.26 16.957 0.270 2.000
Browse 0.256 0.62 9.765 0.500 2.000
CreateVehicleEJB 0.129 0.11 3.324 0.200 5.000
CreateVehicleWS 0.127 0.10 2.694 0.225 5.000
Reproducibility Run (SPECjEnterprise2010 EjOPS) 57,424.78

Oracle WebLogic Server Standard Edition Release 12.1.1
Vendor: Oracle Corporation Availability: Dec-2011
CTS Version: 6.0 Date Passed CTS: Dec-2011
OS Name: Solaris 11.1 64-bit
EJB Protocol: RMI/T3

Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_15
Vendor: Oracle Corporation Availability: Feb-2013
OS Name: Solaris 11.1 64-bit

Oracle JDBC Driver 11.2.0.3(Thin)
Vendor: Oracle Corporation Availability: Sep-2011
OS Name: Solaris 11.1 64-bit

Oracle Database 11g Enterprise Edition Release 11.2.0.3
Vendor: Oracle Corporation Availability: Sep-2011
OS Name: Solaris 11.1 64-bit

JEE Application Server
JEE Product: Oracle WebLogic Server Standard Edition Release 12.1.1
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_15
JDBC Product: Oracle JDBC Driver 11.2.0.3(Thin)
Hardware: JEE AppServer HW
# of Instances: 16
Interfaces:
Web Interface for the Order Domain
Web Services Interface for the Supplier Domain
EJB Interface for the Manufacturing Domain
Web Services Interface for the Manufacturing Domain
Notes / Tuning Information
JVM Options:
-d64 -server -XX:AllocatePrefetchDistance=256 -XX:AllocatePrefetchStyle=1
-Xms12g -Xmx12g -Xmn6g -Xss256k -XX:MaxPermSize=256m -XX:+AggressiveOpts
-XX:+UseParallelGC -XX:ParallelGCThreads=24 -verbose:gc -XX:+PrintGCDetails
-XX:+PrintGCTimeStamps -XX:-TraceClassUnloading -XX:+UseParallelOldGC
-XX:ReservedCodeCacheSize=64m -XX:CICompilerCount=8 -XX:+UseCompressedOops
-XX:-UseBiasedLocking -XX:+AlwaysPreTouch -XX:InitialSurvivorRatio=4
-XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:-UseAdaptiveSizePolicy
-XX:LargePageSizeInBytes=2g
-Dweblogic.SocketReaders=16 -Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true
-Doracle.jdbc.defaultRowPrefetch=200 -Dweblogic.management.discover=false
-Dweblogic.llr.table.specjds=wl_llr_jent31
-Djavax.xml.parsers.DocumentBuilderFactory=weblogic.xml.jaxp.RegistryDocumentBuilderFactory
-Dweblogic.threadpool.MinPoolSize=30 -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0
-Dcom.sun.xml.ws.spi.db.BindingContextFactory=com.sun.xml.ws.db.glassfish.JAXBRIContextFactory
-Djavax.xml.bind.JAXBContext=com.sun.xml.bind.v2.ContextFactory

Java process started in FX class using /usr/bin/priocntl -e -c FX
Java process started with LD_PRELOAD_64=/usr/lib/sparcv9/libumem.so

Emulator Software Config
JEE Product: Oracle WebLogic Server Standard Edition Release 12.1.1
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_15
Hardware: Load Driver & Emulator HW
# of Instances: 14
Notes / Tuning Information
JVM Options:
-d64 -server -Xms20g -Xmx20g -Xmn3g -Xss256k -XX:+AggressiveOpts
-XX:+UseParallelGC -XX:ParallelGCThreads=32 -XX:LargePageSizeInBytes=4m
-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:-TraceClassUnloading
-XX:PermSize=256m -XX:MaxPermSize=512M -XX:+UseCompressedOops
-Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0 -Dhttp.keepAliveCache.lifeTime=600000
-Dweblogic.management.discover=false -Dweblogic.SocketReaders=1
-Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true

Java process started in FX class using /usr/bin/priocntl -e -c FX
Java process started with LD_PRELOAD_64=/usr/lib/amd64/libumem.so


Database Software Config
DB Product: Oracle Database 11g Enterprise Edition Release 11.2.0.3
Hardware: Database Server HW
# of Instances: 1
Character Set: US7ASCII
Notes / Tuning Information
Database Options:

db_name                         = spec
control_files                   = ?/dbs/cntrlspec
cpu_count                       = 256
aq_tm_processes                 = 0
compatible                      = 11.2.0.3.0.0
db_block_size                   = 2048
db_block_checksum               = FALSE
db_block_checking               = FALSE
db_cache_size                   = 14G
db_cache_advice                 = off
db_4k_cache_size                = 10G
db_8k_cache_size                = 4G
db_keep_cache_size              = 10G
db_recycle_cache_size           = 1G
db_file_multiblock_read_count   = 128
db_files                        = 256
db_writer_processes             = 32
deferred_segment_creation       = false
ddl_lock_timeout                = 30
disk_asynch_io                  = TRUE
dml_locks                       = 1000
filesystemio_options            = setall
log_buffer                      = 100663296
log_checkpoint_interval         = 0
log_checkpoints_to_alert        = TRUE
open_cursors                    = 2400
parallel_max_servers            = 100
processes                       = 8000
query_rewrite_enabled           = FALSE
replication_dependency_tracking = FALSE
sessions                        = 12000
shared_pool_size                = 16G
statistics_level                = BASIC
timed_statistics                = false
trace_enabled                   = false
transactions                    = 12000
transactions_per_rollback_segment = 1
undo_management                 = AUTO
undo_retention                  = 600
undo_tablespace                 = undo_ts

Oracle processes run in 8 processor sets using psrset -b pset PID
and each process run in the FX class using /usr/bin/priocntl -s -c FX -i pid PID.
Oracle Log Writer run in a processor set containing a single core
using psrset -b pset PID and run in the RT class using
usr/bin/priocntl -s -c RT -p 1 -i PID.
The processor set configuration is in the FDA.

Driver Software Config
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_15
Hardware: Load Driver & Emulator HW
# of Instances: 18
Notes / Tuning Information
JVM Options
-d64 -server -Xms6400M -Xmx6400M -Xss256k -Dsun.net.inetaddr.ttl=0
-Dnetworkaddress.cache.ttl=0 -Djava.net.preferIPv4Stack=true -verbosegc
-Dhttp.keepAliveCache.lifeTime=600000 -XX:+PrintFlagsFinal
-Dcom.sun.xml.ws.spi.db.BindingContextFactory=com.sun.xml.ws.db.glassfish.JAXBRIContextFactory
-Djavax.xml.bind.JAXBContext=com.sun.xml.bind.v2.ContextFactory


JEE AppServer HW (SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: SPARC T5-8 OS Name: Oracle Solaris 11.1 64-bit SRU 4.5
Processor: SPARC T5 Filesystem: ZFS
MHz: 3600 Disks: 4x 300GB 10K RPM SAS, 4x 100GB SDD
# of CPUs: 128 cores, 8 chips, 16 cores/chip (128 HW threads/chip) Network Interface: 8x 10 Gbit dual-port NICs
Memory (MB): 2097152 Other Hardware:
DIMM[0] Count: 128 DIMM[0] Size: 16384
L1 Cache: 16KB(I)+16KB(D) per core # of Systems: 1
L2 Cache: 128 KB (I+D) per core H/W Available: Mar-2013
Other Cache: 8 MB (I+D) per chip OS Available: Feb-2013
Notes / Tuning Information
Tuning in /etc/system:
set autoup = 345600
set plat_disable_mempm = 1

Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_xmit_hiwat 524288
ndd -set /dev/tcp tcp_recv_hiwat 524288
ndd -set /dev/tcp tcp_smallest_anon_port 4096
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_time_wait_interval 10000
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 10000
ndd -set /dev/udp udp_recv_hiwat 2097152
ndd -set /dev/udp udp_xmit_hiwat 2097152

Tuning in /kernel/drv/ixgbe.conf:
ixgbe[4/6/8/10/12/14/16/18]: intr_throttling=3000
ixgbe[5/7/9/11/13/15/17/19]: intr_throttling=500

Configuration Notes:
16 application server instances were hosted in 16 separate Solaris Containers.
The 16 Containers were bound to separate processor sets where each pset
consisted of 58 HW threads using /usr/sbin/psrset -b PSET PID. Interrupts
were enabled on remaining HW strands in the default processor set.
The Solaris Container and Processor Set configuration is in the FDA.
Each Container on the system was configured with 2 subnets.
8x 10 Gbit NIC ports were shared by 16 containers for driver requests.
8x 10 Gbit NIC ports were shared by 16 containers for database access.
Interrupts from the Network controllers were configured across the
processors in the default set using the /usr/sbin/pcitool utility.
Stop intrd.
Solaris 11.1 Support Repository Update 4.5


Database Server HW (SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Oracle SPARC T5-8 OS Name: Oracle Solaris 11.1 64-bit SRU 4.5
Processor: SPARC T5 Filesystem: ZFS
MHz: 3600 Disks: 2x 300GB 10K RPM, see notes
# of CPUs: 128 cores, 8 chips, 16 cores/chip (128 HW threads/chip) Network Interface: 5x 10 Gbit dual-port NICs
Memory (MB): 2097152 Other Hardware: 6x Sun 8Gb FC dual-Port HBA
DIMM[0] Count: 128 DIMM[0] Size: 16384
L1 Cache: 16KB(I)+16KB(D) per core # of Systems: 1
L2 Cache: 128 KB (I+D) per core H/W Available: Mar-2013
Other Cache: 8MB (I+D) on chip per chip OS Available: Feb-2013
Notes / Tuning Information
Tuning in /etc/system:
set autoup = 345600

Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_xmit_hiwat 524288
ndd -set /dev/tcp tcp_recv_hiwat 524288
ndd -set /dev/tcp tcp_smallest_anon_port 4096
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_time_wait_interval 10000
ndd -set /dev/udp udp_recv_hiwat 2097152
ndd -set /dev/udp udp_xmit_hiwat 2097152

External Disk configuration:
6x Sun Server X3-2L each configured with 4x F40 Flash PCI Cards
and COMSTAR software used for database files.
The COMSTAR configuration for the database files is in the FDA
2x 2540 M2 Storage Arrays  each configured with 12x 600GB disks and
2x RAID controllers
Each 2540 M2 Storage Array configured with 2 RAID-1 LUNs, each LUN exported using a separate controller.
Interrupts from the Network controllers on database server were configured across the
processors in the default set using the /usr/sbin/pcitool utility.
Stop intrd.
Solaris 11.1 Support Repository Update 4.5


Load Driver & Emulator HW (non-SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun Fire X4170 M2 OS Name: Solaris 10 9/10 64-bit
Processor: Intel Xeon X5670 Filesystem: UFS
MHz: 2930 Disks: 2 x 146GB 15K RPM SAS
# of CPUs: 12 cores, 2 chips, 6 cores/chip (2 threads/core) Network Interface: 1x 10 Gbit NIC
Memory (MB): 98304 Other Hardware: none
L1 Cache: 32KB(I)+32KB(D) per core # of Systems: 25
L2 Cache: 256KB per core H/W Available: Jul-2010
Other Cache: 8 MB I+D L3 on chip per chip OS Available: Sep-2010
Notes / Tuning Information
Tuning in /etc/system:
set ddi_msix_alloc_limit=8
set ip:ip_soft_rings_cnt=16
Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_xmit_hiwat 524288
ndd -set /dev/tcp tcp_recv_hiwat 524288
ndd -set /dev/tcp tcp_smallest_anon_port 4096
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_time_wait_interval 10000
Configuration Notes:
18 Driver instances ran on 18 systems.
14 Emulator instances ran on 7 systems.


Benchmark Modifications
Schema Modifications:
  Tablespace sizes were increased to support the Injection rate.
  Scripts to create the DB are included in the FDA.
  Table and index initrans were modified.
  Table M_WORKORDER, O_CUSTINVENTORY, O_CUSTOMER, O_ORDERLINE and O_ORDERS were horizontally partitioned.
  Table M_BOM, M_INVENTORY and M_PARTS were hash clustered.
  System managed undo was used.
Load Program Modifications:
  No modifications to the load programs were made.

Benchmark Configuration Information
Isolation Requirement Info:
  The ItemEnt bean was cached for 20 minute intervals by setting:
  eclipselink.query-results-cache.expiry=1200000
  in the ord-orm.xml deployment descriptor.
  
  The benchmark meets the isolation level requirements by
  version column checking on entities against
  the database.
Durability Requirement Info:
  To ensure database durability, RAID 1 was used for the
  database files and database redo logs maintained
  on the Sun Server 3X-2L storage servers and 2540 M2 arrays.
  
  The application server system was configured with 4
  mirrored SSDs for jms and server logs.
Storage Requirement Info:
  An 80 minute run at an injection rate of 36000 increased storage by 94.6 GB
  This extrapolates to 1704 GB storage for a 24 hour run.
  The database was configured with 11.6 TB of mirrored storage.
  

Bill of Materials
Supplier  Description                                   Product #          Qty
--------  -------------------------------------------   ----------------   ---
Application Server:
Oracle    SPARC T5-8 Server, Base Chassis               7104192             1
Oracle    SPARC T5 Processor Module 2xT5 16C 3.6GHz	7104194		    4
Oracle    16GB DDR3 Memory DIMM				7104198		  128
Oracle    300 GB 10K RPM SAS HDD                        7105211		    4
Oracle    100 GB SSD                                    7101422             4
Oracle    10GBE Dual Port SFP+                          1109A-Z             8
Oracle    10 GigE Dual Rate SFP+ SR Transceiver, MMF    2129A              16
Oracle    Power Cord: North America, 4 meter		SELY9P11Z	    4
Oracle    Oracle Solaris 11.1                           7104202             1

Database Server:
Oracle    SPARC T5-8 Server, Base Chassis               7104192             1
Oracle    SPARC T5 Processor Module 2xT5 16C 3.6GHz	7104194		    4
Oracle    16GB DDR3 Memory DIMM				7104198		  128
Oracle    300 GB 10K RPM SAS HDD                        7105211		    2
Oracle    8GB PCI-E Dual FC/GbE Host Adapter            SG-PCIE2FC-EM8-Z    6
Oracle    10GBE Dual Port SFP+                          1109A-Z             5
Oracle    10 GigE Dual Rate SFP+ SR Transceiver, MMF    2129A              10
Oracle    Power Cord: North America, 4 meter		SELY9P11Z	    4
Oracle    Oracle Solaris 11.1                           7104202             1

Storage Servers:
Oracle    Sun Server X3-2L, base chassis                7102750		    6
Oracle    12 Slot Disk cage                             7102743             6
Oracle    2.4 Ghz Intel Xeon E5-2609                    7100604            12
Oracle    8 GB DIMM DDR3                                7100790            12
Oracle    600 GB 10K RPM SAS HDD                        XRA-SS2CF-600G10K2 12
Oracle    Sun Storage 6 Gb SAS PCIe HBA                 SGX-SAS6-INT-Z      6
Oracle    Sun StorageTek 8 Gb FC PCIe HBA               SG-PCIE2FC-QF8-N    6
Oracle    Sun Flash Accelerator F40 PCIe Card		7104482		   24
Oracle    Power Cords - 2.5m				333A-25-15-NEMA	   12
Oracle    Solaris 11.1                                  7100734             1

Oracle    Sun Storage 2540-M2 Array			7100183		    2
Oracle    AC Power Supply   		                7100021		    4
Oracle    600 GB 15K RPM SAS2 HDD			7100415		   24
Oracle    Power Cords - 2.5m				333A-25-15-NEMA	    4

Oracle    Oracle Premier Support for Systems 3 years    Q-PREM-SPRT-SYS     1

Oracle    Oracle Database 11gR2 Enterprise Edition, Per Processor
-         for 3 years                                                      64*
Oracle    Partitioning, Per Processor, for 3 years                         64*
Oracle    Oracle Premium Support for 3 years                                2

Oracle    Oracle WebLogic Server Standard Edition Release 12.1.1
-         Per Processor for 3 years                                        64*
Oracle    Oracle Premium Support for 3 years                                1

(* 64 = 0.5 * 128) Explanation:  For the purposes of counting
the number of processors which require licensing, a multicore chip with 'n' core
shall be determined by multiplying 'n' cores by a factor of 0.5.

(* 64 = 0.5 * 128) Explanation:  For the purposes of counting
the number of processors which require licensing, a multicore chip with 'n' core
shall be determined by multiplying 'n' cores by a factor of 0.5



Other Benchmark Information
  DNS round robin load balancing was used with two DNS servers running
  on the database and application servers. The DNS named processes
  were run in the RT class using /usr/bin/priocntl -s -c RT -p 1 -i pid.
  All network connections were 10 Gbit.
  

General Notes
The only errors in the driver log files were those that are
normally generated by this benchmark.

On the database, incremental checkpointing ensured that no buffer will
remain dirty (in the cache) for more than the allowed time.



For questions about this result, please contact the submitter: Oracle Corporation
For other inquiries, please contact webmaster@spec.org

Copyright © 2009-2013 Standard Performance Evaluation Corporation

First published at SPEC.org on 26-Mar-2013