Uploaded image for project: 'Apache Trafodion (Retired)'
  1. Apache Trafodion (Retired)
  2. TRAFODION-1910

mxosrvr crashes on Hive query after reconnect

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.3-incubating
    • 2.0-incubating
    • sql-exe
    • None

    Description

      This is a problem Wei-Shiun found when running tests with many connections that use Hive queries. He sees intermittent core dumps with this stack trace:

      #0 0x00007f47cb0dd625 in raise () from /lib64/libc.so.6
      0000001 0x00007f47cb0ded8d in abort () from /lib64/libc.so.6
      0000002 0x00007f47cc613a55 in os::abort(bool) ()
      from /usr/java/jdk1.7.0_67-cloudera/jre/lib/amd64/server/libjvm.so
      0000003 0x00007f47cc793f87 in VMError::report_and_die() ()
      from /usr/java/jdk1.7.0_67-cloudera/jre/lib/amd64/server/libjvm.so
      0000004 0x00007f47cc61896f in JVM_handle_linux_signal ()
      from /usr/java/jdk1.7.0_67-cloudera/jre/lib/amd64/server/libjvm.so
      0000005 <signal handler called>
      0000006 0x00007f47c92bd5ee in HiveMetaData::recordError (this=0x7f47a5e50088,
      errCode=122, errMethodName=0x7f47c935aaa3 "HiveClient_JNI::getTableStr()")
      at ../executor/hiveHook.cpp:228
      0000007 0x00007f47c92bf613 in HiveMetaData::getTableDesc (this=0x7f47a5e50088,
      schemaName=0x7f47b858e798 "mytest5", tblName=0x7f47b858e7c8 "mytable")
      at ../executor/hiveHook.cpp:806
      0000008 0x00007f47c4056307 in NATableDB::get (this=0x7f47b652d3c0, corrName=...,
      bindWA=0x7f47b85912d0, inTableDescStruct=<value optimized out>)
      at ../optimizer/NATable.cpp:8377
      0000009 0x00007f47c3db0743 in BindWA::getNATable (this=0x7f47b85912d0,
      corrName=..., catmanCollectTableUsages=1, inTableDescStruct=0x0)
      at ../optimizer/BindRelExpr.cpp:1514
      0000010 0x00007f47c3db3290 in Describe::bindNode (this=0x7f47a2aae440,
      bindWA=0x7f47b85912d0) at ../optimizer/BindRelExpr.cpp:13565
      0000011 0x00007f47c3d989f7 in RelExpr::bindChildren (this=0x7f47a2aaf5f8,
      bindWA=0x7f47b85912d0) at ../optimizer/BindRelExpr.cpp:2258
      0000012 0x00007f47c3dccbce in RelRoot::bindNode (this=0x7f47a2aaf5f8,
      bindWA=0x7f47b85912d0) at ../optimizer/BindRelExpr.cpp:5204
      0000013 0x00007f47c577e84e in CmpMain::compile (this=0x7f47b8593c40,
      input_str=0x7f47a5e0b690 "showddl mytable", charset=15,
      queryExpr=@0x7f47b8593b78, gen_code=0x7f47a5e0c1a8,
      gen_code_len=0x7f47a5e0c1a0, heap=0x7f47b70bbc00, phase=CmpMain::END,
      fragmentDir=0x7f47b8593d98, op=3004, useQueryCache=1,
      cacheable=0x7f47b8593b88, begTime=0x7f47b8593b60, shouldLog=0)
      at ../sqlcomp/CmpMain.cpp:2071
      0000014 0x00007f47c578168c in CmpMain::sqlcomp (this=0x7f47b8593c40,
      input_str=0x7f47a5e0b690 "showddl mytable", charset=15,
      queryExpr=@0x7f47b8593b78, gen_code=0x7f47a5e0c1a8,
      gen_code_len=0x7f47a5e0c1a0, heap=0x7f47b70bbc00, phase=CmpMain::END,
      fragmentDir=0x7f47b8593d98, op=3004, useQueryCache=1,
      cacheable=0x7f47b8593b88, begTime=0x7f47b8593b60, shouldLog=0)
      at ../sqlcomp/CmpMain.cpp:1684
      0000015 0x00007f47c5782998 in CmpMain::sqlcomp (this=0x7f47b8593c40, input=...,
      gen_code=0x7f47a5e0c1a8, gen_code_len=0x7f47a5e0c1a0, heap=0x7f47b70bbc00,
      phase=CmpMain::END, fragmentDir=0x7f47b8593d98, op=3004)
      at ../sqlcomp/CmpMain.cpp:819
      0000016 0x00007f47c33a8898 in CmpStatement::process (this=0x7f47a5e52f10,
      sqltext=<value optimized out>) at ../arkcmp/CmpStatement.cpp:499
      0000017 0x00007f47c339b48c in CmpContext::compileDirect (this=0x7f47b6525090,
      data=0x7f47b7112db8 "\200", data_len=144, outHeap=0x7f47b7b2e128,
      charset=15, op=CmpMessageObj::SQLTEXT_COMPILE, gen_code=@0x7f47b8594320,
      gen_code_len=@0x7f47b8594328, parserFlags=4194304, parentQid=0x0,
      parentQidLen=0, diagsArea=0x7f47b7112e50) at ../arkcmp/CmpContext.cpp:841
      0000018 0x00007f47caa0dd38 in CliStatement::prepare2 (this=0x7f47b70d4028,
      source=0x7f47b711ab18 "showddl mytable", diagsArea=...,
      passed_gen_code=<value optimized out>, passed_gen_code_len=3081953576,
      charset=15, unpackTdbs=1, cliFlags=129) at ../cli/Statement.cpp:1775
      0000019 0x00007f47ca9bac94 in SQLCLI_Prepare2 (cliGlobals=0x27bcbb0,
      statement_id=0x370a9c8, sql_source=0x7f47b8594610, gencode_ptr=0x0,
      gencode_len=0, ret_gencode_len=0x0, query_cost_info=0x370abf8,
      query_comp_stats_info=0x370ac48, uniqueStmtId=<value optimized out>,
      uniqueStmtIdLen=0x370ab2c, flags=1) at ../cli/Cli.cpp:5927
      0000020 0x00007f47caa1b1ae in SQL_EXEC_Prepare2 (statement_id=0x370a9c8,
      sql_source=0x7f47b8594610, gencode_ptr=0x0, gencode_len=0,
      ret_gencode_len=0x0, query_cost_info=0x370abf8, comp_stats_info=0x370ac48,
      uniqueStmtId=0x370ab30 "", uniqueStmtIdLen=0x370ab2c, flags=1)
      at ../cli/CliExtern.cpp:5034
      0000021 0x00007f47cd4e31d9 in SRVR::WSQL_EXEC_Prepare2 (statement_id=0x370a9c8,
      sql_source=<value optimized out>, gencode_ptr=<value optimized out>,
      gencode_len=<value optimized out>, ret_gencode_len=<value optimized out>,
      query_cost_info=<value optimized out>, comp_stats_info=0x370ac48,
      uniqueQueryId=0x370ab30 "", uniqueQueryIdLen=0x370ab2c, flags=1)
      at SQLWrapper.cpp:803
      0000022 0x00007f47cd4d7b45 in SRVR::PREPARE2 (pSrvrStmt=0x370a3b0,
      isFromExecDirect=248) at sqlinterface.cpp:5057
      0000023 0x00007f47cd508370 in odbc_SQLSvc_Prepare2_sme_ (inputRowCnt=0,
      sqlStmtType=1, stmtLabel=<value optimized out>,
      sqlString=0x2ba7254 "showddl mytable", holdableCursor=0,
      returnCode=0x7f47b8594b08, sqlWarningOrErrorLength=0x7f47b8594b04,
      sqlWarningOrError=@0x7f47b8594ae0, sqlQueryType=0x7f47b8594afc,
      stmtHandle=0x7f47b8594ac0, estimatedCost=0x7f47b8594af8,
      inputDescLength=0x7f47b8594af0, inputDesc=@0x7f47b8594ad0,
      outputDescLength=0x7f47b8594aec, outputDesc=@0x7f47b8594ac8,
      isFromExecDirect=true) at srvrothers.cpp:939
      0000024 0x00000000004c6ca2 in odbc_SQLSrvr_ExecDirect_ame_ (objtag_=0x55e6ec0,
      call_id_=0x55e6f18, dialogueId=259570813, stmtLabel=0x2ba7270 "SQL_CUR_7",
      cursorName=0x0, stmtExplainLabel=<value optimized out>, stmtType=0,
      sqlStmtType=1, sqlString=0x2ba7254 "showddl mytable", sqlAsyncEnable=0,
      queryTimeout=0, inputRowCnt=0, txnID=0, holdableCursor=0)
      at SrvrConnect.cpp:7894
      0000025 0x0000000000495886 in SQLEXECUTE_IOMessage (objtag_=0x55e6ec0,
      call_id_=0x55e6f18, operation_id=3012) at Interface/odbcs_srvr.cpp:1731
      0000026 0x0000000000495934 in DISPATCH_TCPIPRequest (objtag_=0x55e6ec0,
      call_id_=0x55e6f18, operation_id=<value optimized out>)
      at Interface/odbcs_srvr.cpp:1796
      0000027 0x0000000000434532 in BUILD_TCPIP_REQUEST (pnode=0x55e6ec0)
      at ../Common/TCPIPSystemSrvr.cpp:606
      0000028 0x0000000000434ecd in PROCESS_TCPIP_REQUEST (pnode=0x55e6ec0)
      at ../Common/TCPIPSystemSrvr.cpp:584
      0000029 0x00000000004631a6 in CNSKListenerSrvr::tcpip_listener (arg=0x2663560)
      at Interface/linux/Listener_srvr_ps.cpp:403
      0000030 0x00007f47cae91314 in sb_thread_sthr_disp (pp_arg=0x27a94a0)
      at threadl.cpp:256
      0000031 0x00007f47cac5da51 in start_thread () from /lib64/libpthread.so.0
      0000032 0x00007f47cb19393d in clone () from /lib64/libc.so.6

      The problem does not happen with sqlci.

      Attachments

        Activity

          People

            hzeller Hans Zeller
            hzeller Hans Zeller
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: