Errors in dbsrver VM when loaddb_postgres.sh is executed

[Miles]

Hi
[1]
The link for the JDBC driver in my dbserver :
  [root@dbserver Desktop]# ls -l /opt/SPECjAppServer2004/jdbc/postgresql.jar
  lrwxrwxrwx. 1 root root 34 Jul  7 10:36 /opt/SPECjAppServer2004 
  /jdbc/postgresql.jar -> /opt/postgresql-9.2-1004-jdbc4.jar
[2]
There's only one instance of the following parameters in /etc/sysctl.conf:
        kernel.sem = 500 64000 400 512
        kernel.shmmax = 137438953472 
        kernel.shmmni = 11118096
        kernel.shmall = 8294967296
[3]
I don't see any PostgreSQL errors at the end of /var/log/messages.
[4]
I have executed makeme_exampleVM.sh at the first and     
      10.10.1.5       dbserver1-int specdb
  is added.
[5]
Now the result returned is :
[root@dbserver other_scripts]# ./loaddb_postgres.sh 500
Script started Wed Jul 12 10:08:10 CST 2017
sleep 10
Starting Database Load
Loading database with orders_injection_rate = 500
Loading database with numThreads  = 4
Loading Databases ...
INFO : IR supplied : 500
INFO : stepped IR  : 500
org.postgresql.util.PSQLException: ERROR: current transaction is aborted, commands ignored until end of transaction block
   at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2157)
   at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1886)
   at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:255)
   at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:559)
   at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:417)
   at org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:363)
   at org.spec.jappserver.load.LoadCorp.cleanAll(LoadCorp.java:171)
   at org.spec.jappserver.load.LoadCorp.main(LoadCorp.java:152)
   at org.spec.jappserver.load.LoadAll.main(LoadAll.java:51)
Exception in thread "main" java.lang.RuntimeException: Failed to load Corp domain properlyERROR: current transaction is aborted, commands ignored until end of transaction block
   at org.spec.jappserver.load.LoadAll.main(LoadAll.java:55)
Ignoring read() errors...
Ignoring read() errors...
Ignoring read() errors...
Launcher: done waiting.
Finished Database Load
Script ended Wed Jul 12 10:08:20 CST 2017


Thanks.

[lroderic]

What do you see when you issue ifconfig on the dbserver?

Lisa

[Miles]

Hi Lisa
I just followed emampleVM_scripts to build my testbed.

[root@dbserver Desktop]# ifconfig
eth0      Link encap:Ethernet  HWaddr 52:54:00:1D:1A:75 
          inet addr:10.10.1.5  Bcast:10.10.255.255  Mask:255.255.0.0
          inet6 addr: fe80::5054:ff:fe1d:1a75/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:36681 errors:0 dropped:0 overruns:0 frame:0
          TX packets:26 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:1912932 (1.8 MiB)  TX bytes:2133 (2.0 KiB)

eth1      Link encap:Ethernet  HWaddr 52:54:00:11:C3:73 
          inet addr:192.168.1.5  Bcast:192.168.1.255  Mask:255.255.255.0
          inet6 addr: 2000:2:3:4:5054:ff:fe11:c373/64 Scope:Global
          inet6 addr: 2001:db8:0:1:5054:ff:fe11:c373/64 Scope:Global
          inet6 addr: fe80::5054:ff:fe11:c373/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:1080563 errors:0 dropped:0 overruns:0 frame:0
          TX packets:209 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:102138149 (97.4 MiB)  TX bytes:41318 (40.3 KiB)

lo        Link encap:Local Loopback 
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:19368 errors:0 dropped:0 overruns:0 frame:0
          TX packets:19368 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:2620964 (2.4 MiB)  TX bytes:2620964 (2.4 MiB)

virbr0    Link encap:Ethernet  HWaddr 52:54:00:83:F7:89 
          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

[lroderic]

Hi Miles. I made corrections to the scripts and would like for you to retry creating dbserver. Please clone your VM to create a clean dbserver, reinstall SPECvirt (if needed), and download then unpack the attached in /opt. Again, I apologize for the inconvenience.

Lisa

[Miles]

Hi Lisa
I have reinstalled and use optdirs-sc2013-v1.04 to setup my dbserver,
   but I got below error message when executing loaddb.sh
org.postgresql.util.PSQLException: ERROR: current transaction is aborted, commands ignored until end of transaction block
   I will try to find out which steps not included in scripts I missed or made mistakes.

Thanks for your help.

[lroderic]

When you cloned the create a fresh dbserver, did you use a CentOS 6 or 7 VM? The scripts work for me on CentOS 6.x.

Please reboot the VM. That's not in the instructions, but I found I had to do it manually after makeme_dbserver.sh applies the /etc/sysctl.conf shared memory settings.

After the reboot, can you do:

psql -U spec -d specdb

And see:

psql -U spec -d specdb
psql (8.4.20, server 9.2.21)
WARNING: psql version 8.4, server version 9.2.
         Some psql features might not work.
Type "help" for help.

specdb=#

If that works, Ctrl+D to exit. Let's turn off IPV6:

sysctl -w net.ipv6.conf.default.disable_ipv6=1
sysctl -w net.ipv6.conf.all.disable_ipv6=1

Then retry /opt/other_scripts/loaddb_postgres.sh.

Lisa

[Miles]

Hi Lisa
It works in my CentOS6.5 now!
I think two different versions of postgresql resulted in my problem.
After I uninstalled postgresql_8.4  contained in CentOS6.5, the errors disappeared.

Thanks for your help.

[lroderic]

Glad to hear it! I'll add an instruction to remove PostgreSQL 8 before proceeding.

Lisa

[Miles]

Hi
Now I am trying to run with 6T3W(app, batch and mail workloads), but always see below message in clientmgr1_1088.out:
-> For txRate(100), loadFactor(5), and load_scale_factor(1.0), your DBIR must be built for 500IR

Even if I re-run loaddb_postgres.sh in both dbservers, the message still happen and the run is aborted.

[lroderic]

This is an informational message, not an error message. You're always going to see it. What do the Client logs report?

Lisa

[Miles]

Hi
Now I understand the message is not a error. Thanks.
The error I should try to fix  is below:
"O1:2041: error adding cars to cart for customer 2590686 - Part 2 java.lang.NullPointerException"
"O1:1697: error adding cars to cart for customer 1105229 - Part 2 java.lang.NullPointerException"
"O1:956: error adding cars to cart for customer 1440489 - Part 2 java.lang.NullPointerException"

And I have a question:
The Use% of "/" directory in appserver will increase while running.
How and what should I release after each run?

Thanks.

[lroderic]

On occasion you'll get these "error adding cars to cart" messages. If you have a few, they're fine and you can ignore them. I'll update the Technical Support FAQ at https://www.spec.org/virt_sc2013/docs/SPECvirt_TechnicalSupport.html with this info.

The root directory on appserver will fill up over time. jAppInit.sh and jAppInitRstr.sh will issue commands to remove:

Code: [Select]

/opt/glassfish3/glassfish/domains/spec2004-1/imq/instances/imqbroker/log/*"
/opt/glassfish3/glassfish/domains/spec2004-1/imq/instances/imqbroker/fs370/*"
/opt/glassfish3/glassfish/domains/spec2004-1/logs/server.log*

The full results of the appserver run are kept in /opt/SPECjAppServer2004/output/# where # is the sequence number of the run. You could remove the directories for the older test runs. Or you could add a disk to appserver and soft link it to /opt/SPECjAppServer2004.

You're making progress! 

Lisa

[Miles]

Hi
jAppInit.sh and jAppInitRstr.sh work, thanks.

There are many Validation Errors in my report and the application score is almost "0".
According to SPECvirt_sc2013 Technical Support, it said
"To find a sample domain.xml file, extract the archive and look under the Virtualization folder (VIRT) and select any tile. Then navigate through the appserver folder to software (SOFTW) then spec2004-01 then config where domain.xml resides. "
I just download a domain.xml to and copy to my appservers, but SPECvirt cannot start to run.
So, what values and how do I modify them to meet my 6T3W run? increase or decrease?

Thanks.

[lroderic]

Go back to the original domain.xml you had before. Please post the output of the errors in the Clientmgr out files.

Lisa

[Miles]

Hi
Sorry, I don't know why I cannot attach my logs.
There are so many errors such as :

-> O1:492: error adding cars to cart for customer 10155 - Part 2 java.lang.NullPointerException
-> O1:779: error adding cars to cart for customer 3045993 - Part 2 java.lang.NullPointerException
-> O1:273: error adding cars to cart for customer 131422 - Part 2 java.lang.NullPointerException
-> O1:71: error adding cars to cart for customer 1424268 - Part 2 java.lang.NullPointerException
-> O1:73: error adding cars to cart for customer 2392633 - Part 2 java.lang.NullPointerException
-> O1:149: error adding cars to cart for customer 1611828 - Part 2 java.lang.NullPointerException
-> O1:64: error adding cars to cart for customer 2635826 - Part 2 java.lang.NullPointerException
-> O1:352: error adding cars to cart for customer 993335 - Part 2 java.lang.NullPointerException
-> O1:957: error adding cars to cart for customer 1941322 - Part 2 java.lang.NullPointerExcepti

    ...

java version "1.7.0_45"


Thanks.