JVM Options:
-d64 -server -Xms26g -Xmx26g -Xmn23296m -Xss384k -XX:MetaspaceSize=200M -XX:+AggressiveOpts
-XX:+UseParallelOldGC -XX:ParallelGCThreads=32 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps
-XX:InitialCodeCacheSize=200m -XX:ReservedCodeCacheSize=200m -XX:+UseCompressedOops -XX:-UseBiasedLocking
-XX:+AlwaysPreTouch -XX:InitialSurvivorRatio=24 -XX:SurvivorRatio=24 -XX:TargetSurvivorRatio=90
-XX:-UseAdaptiveSizePolicy -XX:LargePageSizeInBytes=256m -XX:CICompilerCount=6 -XX:InlineSmallCode=1500
-Djava.nio.channels.spi.SelectorProvider=sun.nio.ch.EventPortSelectorProvider
-Dweblogic.ProductionModeEnabled=true -Dweblogic.management.discover=false
-Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true -Doracle.jdbc.defaultRowPrefetch=200
-Djavax.xml.parsers.DocumentBuilderFactory=weblogic.xml.jaxp.RegistryDocumentBuilderFactory
-Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0 -Dweblogic.SocketReaders=8
-Dcom.sun.xml.ws.spi.db.BindingContextFactory=com.sun.xml.ws.db.glassfish.JAXBRIContextFactory
-Djavax.xml.bind.JAXBContext=com.sun.xml.bind.v2.ContextFactory

Java process started in FX class using /usr/bin/priocntl -e -c FX
Java process started with LD_PRELOAD_64=/usr/lib/sparcv9/libumem.so.1

JVM Options:
-d64 -server -Xms20g -Xmx20g -Xmn3g -Xss256k -XX:MetaspaceSize=200M -XX:+AggressiveOpts
-XX:+UseParallelGC -XX:ParallelGCThreads=32 -XX:LargePageSizeInBytes=2m
-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+UseCompressedOops
-Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0 -Dhttp.keepAliveCache.lifeTime=600000
-Dweblogic.ProductionModeEnabled=true -Dweblogic.management.discover=false
-Dweblogic.SocketReaders=1 -Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true
-Djavax.xml.parsers.DocumentBuilderFactory=weblogic.xml.jaxp.RegistryDocumentBuilderFactory

Java process started in FX class using /usr/bin/priocntl -e -c FX
Java process started with LD_PRELOAD_64=/usr/lib/amd64/libumem.so.1

db_name                         = spec
control_files                   = +DATA/cntrlspec
cpu_count                       = 64
aq_tm_processes                 = 0
compatible                      = 12.1.0.1.0.0
db_block_size                   = 2048
db_block_checksum               = FALSE
db_block_checking               = FALSE
db_cache_size                   = 19512M
db_cache_advice                 = off
db_4k_cache_size                = 10G
db_8k_cache_size                = 4G
db_keep_cache_size              = 10G
db_file_multiblock_read_count   = 128
db_files                        = 256
db_writer_processes             = 8
deferred_segment_creation       = false
ddl_lock_timeout                = 30
disk_asynch_io                  = TRUE
dml_locks                       = 1000
filesystemio_options            = setall
log_buffer                      = 100663296
log_checkpoint_interval         = 0
log_checkpoints_to_alert        = TRUE
open_cursors                    = 2400
parallel_max_servers            = 100
processes                       = 8000
query_rewrite_enabled           = FALSE
replication_dependency_tracking = FALSE
sessions                        = 12000
shared_pool_size                = 16G
statistics_level                = BASIC
timed_statistics                = false
trace_enabled                   = false
transactions                    = 12000
transactions_per_rollback_segment = 1
undo_management                 = AUTO
undo_retention                  = 30
undo_tablespace                 = undo_ts

Grid Infrastructure was installed to use Oracle ASM for DATA and LOG disk groups.
Oracle database processes run in 2 processor sets where each pset is configured with 48 HW strands.
Each process runs in the FX class using /usr/bin/priocntl -s -c FX -i pid PID.
Oracle Log Writer runs in a processor set containing 8 HW strands from a single core,
and runs in RT class using /usr/bin/priocntl -s -c RT -p 1 -i PID.
Oracle DB writers run in a processor set containing 8 HW strands from a single core.
The remaining two cores were used for HBA and network interrupts.
Oracle Tablespace Data Encryption was enabled on the application tablespaces using AES_256 cipher.
Oracle Network Data Encryption was enabled on the JDBC connections using RC4_128 cipher.

-d64 -server -Xms6400M -Xmx6400M -Xss256k -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0
-Djava.net.preferIPv4Stack=true -verbosegc -Dhttp.keepAliveCache.lifeTime=600000 -XX:+PrintFlagsFinal
-Dcom.sun.xml.ws.spi.db.BindingContextFactory=com.sun.xml.ws.db.glassfish.JAXBRIContextFactory
-Djavax.xml.bind.JAXBContext=com.sun.xml.bind.v2.ContextFactory

Tuning in /etc/system:
set autoup = 345600
set rlim_fd_max = 131072

Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_xmit_hiwat 1048576
ndd -set /dev/tcp tcp_recv_hiwat 1048576
ndd -set /dev/tcp tcp_smallest_anon_port 4096
ndd -set /dev/tcp tcp_naglim_def 1

NIC Tuning for driver and emulator communication:
ndd -set /dev/ixgbe[3/1] intr_throttling 2000

Configuration Notes:
Two application server instances were hosted in the global zone
The application server instance's processes were bound to separate processor sets where each pset consisted of 58 HW strands
using /usr/sbin/psrset -b PSET PID. Interrupts were enabled on remaining HW strands in the default processor set.
Each application server instance on the system was configured with 2 subnets.
2x 10 Gbit NIC ports were used for driver requests.
2x 10 Gbit onboard NIC ports were used for JDBC access where each NIC was dedicated to one application server instance.
Interrupts from the Network controllers were configured across the
processors in the default set using the /usr/sbin/pcitool utility.
Stop intrd.

Mirrored SSDs were used for JMS and server log files.

Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_xmit_hiwat 524288
ndd -set /dev/tcp tcp_recv_hiwat 524288
ndd -set /dev/tcp tcp_smallest_anon_port 4096
ndd -set /dev/tcp tcp_naglim_def 1

Configuration Notes:
1x 10 Gbit NIC port used for DNS requests.
2x 10 Gbit onboard NIC ports were for JDBC access.
Interrupts from the HBAs & Network controller were configured across the
processors in the default set using the /usr/sbin/pcitool utility.
Stop intrd.

External storage configuration:
1x Oracle Server X6-2L configured with 2x 3.2 TB NVMe PCIe SSDs,
2x 600GB SAS-3 Disks, and 1x Sun 16Gb FC Dual Port HBA for the database files.
1x Oracle Server X6-2L configured with 14x 600 GB disks, 1x Sun 16Gb FC
Dual Port HBA, and onboard PCI HW Raid controller for redo logs.

Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_xmit_hiwat 524288
ndd -set /dev/tcp tcp_recv_hiwat 524288
ndd -set /dev/tcp tcp_smallest_anon_port 4096
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_time_wait_interval 10000

Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 65536
ndd -set /dev/tcp tcp_conn_req_max_q0 65536
ndd -set /dev/tcp tcp_xmit_hiwat 1048576
ndd -set /dev/tcp tcp_recv_hiwat 1048576
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_time_wait_interval 10000
ndd -set /dev/tcp tcp_smallest_anon_port 4096

Configuration Notes:
Four application server instances were hosted in 4 separate Solaris Zones.
The 4 zones were bound to separate processor sets where each pset
consisted of 10 cores using /usr/sbin/psrset -b PSET PID.