Details
-
Bug
-
Status: Closed
-
Critical
-
Resolution: Fixed
-
None
-
None
-
None
Description
This has happened multiple times since Friday on performance test system Zircon4 - reporting the last two since now running 1.0.1rc2 at present.
2015-02-17 18:36:22 ERROR -
>----------------------------------------------------------
> Unexpected SQLEXCEPTION, Error Code = -1
> Stream Number : 989 , Transaction Number : 1
> SingletonSelect , scale = 20 , key_value = user5589248998698799825
> Statement Label could not be allocated. [2015-02-17 18:36:22]
>----------------------------------------------------------
org.trafodion.jdbc.t4.HPT4Exception: Statement Label could not be allocated. [2015-02-17 18:36:22]
at org.trafodion.jdbc.t4.HPT4Messages.throwSQLException(HPT4Messages.java:206)
at org.trafodion.jdbc.t4.InterfaceStatement.prepare(InterfaceStatement.java:1108)
at org.trafodion.jdbc.t4.TrafT4PreparedStatement.prepare(TrafT4PreparedStatement.java:2234)
at org.trafodion.jdbc.t4.TrafT4Connection.prepareStatement(TrafT4Connection.java:772)
at DatabaseConnector.prepare_statement(DatabaseConnector.java:180)
at YCSBWorkload2.runSingletonSelect(YCSBWorkload2.java:268)
at WorkloadDriver.run(WorkloadDriver.java:427)
======================================================================================
An mxosrvr core has occurred both times as well. Stack trace for the two cores are:
echo /local/cores/1005/core.1424198189.n020.5019.mxosrvr
echo
…
[Thread debugging using libthread_db enabled]
Core was generated by `mxosrvr -ZKHOST n014.cm.cluster:2181,n015.cm.cluster:2181,n016.cm.cluster:2181'.
Program terminated with signal 6, Aborted.
#0 0x00007ffff4a328a5 in raise () from /lib64/libc.so.6
#0 0x00007ffff4a328a5 in raise () from /lib64/libc.so.6
#1 0x00007ffff4a3400d in abort () from /lib64/libc.so.6
#2 0x00007ffff5d51a55 in os::abort(bool) () from /usr/java/jdk1.7.0_67/jre/lib/amd64/server/libjvm.so
#3 0x00007ffff5ed1f87 in VMError::report_and_die() () from /usr/java/jdk1.7.0_67/jre/lib/amd64/server/libjvm.so
#4 0x00007ffff5d5696f in JVM_handle_linux_signal () from /usr/java/jdk1.7.0_67/jre/lib/amd64/server/libjvm.so
#5 <signal handler called>
#6 0x00007ffff43119e9 in SQLCLI_PerformTasks(CliGlobals *, ULng32, SQLSTMT_ID *, SQLDESC_ID *, SQLDESC_ID *, Lng32, Lng32, typedef
__va_list_tag __va_list_tag *, SQLCLI_PTR_PAIRS *, SQLCLI_PTR_PAIRS *) (cliGlobals=0xeea9c0, tasks=606, statement_id=0x19ee4d8, inpu
t_descriptor=0x0, output_descriptor=0x0, num_input_ptr_pairs=0, num_output_ptr_pairs=0, ap=0x7fffd22385d0, input_ptr_pairs=0x0, outp
ut_ptr_pairs=0x0) at ../cli/Cli.cpp:2943
#7 0x00007ffff431bbfb in SQLCLI_ExecDirect2(CliGlobals *, SQLSTMT_ID *, SQLDESC_ID *, Int32, SQLDESC_ID *, Lng32, typedef __va_list
_tag __va_list_tag *, SQLCLI_PTR_PAIRS *) (cliGlobals=0xeea9c0, statement_id=0x19ee4d8, sql_source=<value optimized out>, prepFlags=
0, input_descriptor=0x0, num_ptr_pairs=0, ap=0x7fffd22385d0, ptr_pairs=0x0) at ../cli/Cli.cpp:3718
#8 0x00007ffff4377bba in SQL_EXEC_ExecDirect2 (statement_id=0x19ee4d8, sql_source=0x7fffd22387c0, prep_flags=0, input_descriptor=0x
0, num_ptr_pairs=0) at ../cli/CliExtern.cpp:2326
#9 0x00007ffff6a74e17 in SRVR::WSQL_EXEC_ExecDirect (statement_id=0x19ee4d8, sql_source=0x7fffd22387c0, input_descriptor=0x0, num_p
tr_pairs=0) at SQLWrapper.cpp:360
#10 0x00007ffff6a6a8c0 in SRVR::EXECDIRECT (pSrvrStmt=0x19edec0) at sqlinterface.cpp:4479
#11 0x00007ffff6a2e245 in SRVR::ControlProc (pParam=0x19edec0) at csrvrstmt.cpp:757
#12 0x00007ffff6a2f008 in SRVR_STMT_HDL::ExecDirect (this=0x19edec0, inCursorName=0x0, inSqlString=0x1a54498 "insert into Trafodion.
\"REPOS\".metric_query_aggr_table values(0,0,0,5019,5019,9,0,0,'15.250.48.108',0,'$Z09043E','MXID110090050192122909579434510640000
00000206U3333300',CONVERTTIMESTAMP(2122909581694"..., inStmtType=<value optimized out>, inSqlStmtType=<value optimized out>, inSqlAs
yncEnable=<value optimized out>, inQueryTimeout=0) at csrvrstmt.cpp:439
#13 0x00000000004ccb1b in SessionWatchDog (arg=<value optimized out>) at SrvrConnect.cpp:818
#14 0x00007ffff45b2851 in start_thread () from /lib64/libpthread.so.0
#15 0x00007ffff4ae890d in clone () from /lib64/libc.so.6
=====
echo
echo /local/cores/1005/core.1424198231.n014.61369.mxosrvr
echo
…
[Thread debugging using libthread_db enabled]
Core was generated by `mxosrvr -ZKHOST n014.cm.cluster:2181,n015.cm.cluster:2181,n016.cm.cluster:2181'.
Program terminated with signal 6, Aborted.
#0 0x00007ffff4a328a5 in raise () from /lib64/libc.so.6
#0 0x00007ffff4a328a5 in raise () from /lib64/libc.so.6
#1 0x00007ffff4a3400d in abort () from /lib64/libc.so.6
#2 0x00007ffff5d51a55 in os::abort(bool) () from /usr/java/jdk1.7.0_67/jre/lib/amd64/server/libjvm.so
#3 0x00007ffff5ed1f87 in VMError::report_and_die() () from /usr/java/jdk1.7.0_67/jre/lib/amd64/server/libjvm.so
#4 0x00007ffff5d5696f in JVM_handle_linux_signal () from /usr/java/jdk1.7.0_67/jre/lib/amd64/server/libjvm.so
#5 <signal handler called>
#6 SRVR_STMT_HDL::cleanupAll (this=0x0) at csrvrstmt.cpp:625
#7 0x00007ffff6a2ef90 in SRVR_STMT_HDL::ExecDirect (this=0x0, inCursorName=0x0, inSqlString=0x1844e68 "update Trafodion.\"REPOS\"
.metric_query_aggr_table set AGGREGATION_END_UTC_TS = CONVERTTIMESTAMP(212290958231118193),TOTAL_EST_ROWS_ACCESSED = 0,TOTAL_EST_ROW
S_USED = 0,TOTAL_ROWS_RETRIEVED = 0,TOTAL_"..., inStmtType=<value optimized out>, inSqlStmtType=<value optimized out>, inSqlAsyncEna
ble=<value optimized out>, inQueryTimeout=0) at csrvrstmt.cpp:414
#8 0x00000000004ccb1b in SessionWatchDog (arg=<value optimized out>) at SrvrConnect.cpp:818
#9 0x00007ffff45b2851 in start_thread () from /lib64/libpthread.so.0
#10 0x00007ffff4ae890d in clone () from /lib64/libc.so.6