Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-2556

Crash: thrift.transport.TMemoryInputTransport.reset([B)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Cannot Reproduce
    • Impala 2.3.0
    • None
    • None
    • impalad version 2.3.0-cdh5-INTERNAL DEBUG (build ad817a337f2223253139ebc0ada3c1c4a9fde55d)
      Built on Tue, 13 Oct 2015 21:48:43 PST

    Description

      The kerberized stress test run crashed in an unusual way. The bt from gdb doesn't show anything useful. There is an hs_err file and I think it indicates that the crash came from a java call.

      (Note, this run may have been off the 2.3.x branch instead of 2.3.0)

      Stack: [0x00007f327aa7c000,0x00007f327b47d000],  sp=0x00007f327b477be8,  free space=10222k
      Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
      j  org.apache.thrift.transport.TMemoryInputTransport.reset([B)V+0
      j  org.apache.thrift.TDeserializer.deserialize(Lorg/apache/thrift/TBase;[B)V+5
      J 2072 C2 com.cloudera.impala.service.FeSupport.EvalPredicateBatch(Ljava/util/ArrayList;Lcom/cloudera/impala/thrift/TQueryCtx;)Lcom/cloudera/impala/thrift/TResultRow; (154 bytes) @
      0x00007f32f0784758 [0x00007f32f0783820+0xf38]
      J 2025 C2 com.cloudera.impala.planner.HdfsPartitionFilter.getMatchingPartitionIds(Ljava/util/ArrayList;Lcom/cloudera/impala/analysis/Analyzer;)Ljava/util/HashSet; (186 bytes) @ 0x00
      007f32f0726784 [0x00007f32f07250a0+0x16e4]
      J 2063 C2 com.cloudera.impala.planner.HdfsScanNode.evalPartitionFiltersInBe(Ljava/util/List;Ljava/util/HashSet;Lcom/cloudera/impala/analysis/Analyzer;)V (206 bytes) @ 0x00007f32f076
      b5cc [0x00007f32f076ae00+0x7cc]
      J 1975 C2 com.cloudera.impala.planner.HdfsScanNode.prunePartitions(Lcom/cloudera/impala/analysis/Analyzer;)V (415 bytes) @ 0x00007f32f069f100 [0x00007f32f069e820+0x8e0]
      j  com.cloudera.impala.planner.HdfsScanNode.init(Lcom/cloudera/impala/analysis/Analyzer;)V+53
      j  com.cloudera.impala.planner.SingleNodePlanner.createScanNode(Lcom/cloudera/impala/analysis/Analyzer;Lcom/cloudera/impala/analysis/TableRef;)Lcom/cloudera/impala/planner/PlanNode;
      +40
      J 2227 C2 com.cloudera.impala.planner.SingleNodePlanner.createTableRefsPlan(Ljava/util/List;Ljava/util/List;ZLcom/cloudera/impala/analysis/Analyzer;)Lcom/cloudera/impala/planner/Pla
      nNode; (203 bytes) @ 0x00007f32f0883a88 [0x00007f32f0883900+0x188]
      j  com.cloudera.impala.planner.SingleNodePlanner.createSelectPlan(Lcom/cloudera/impala/analysis/SelectStmt;Lcom/cloudera/impala/analysis/Analyzer;)Lcom/cloudera/impala/planner/PlanN
      ode;+168
      j  com.cloudera.impala.planner.SingleNodePlanner.createQueryPlan(Lcom/cloudera/impala/analysis/QueryStmt;Lcom/cloudera/impala/analysis/Analyzer;Z)Lcom/cloudera/impala/planner/PlanNo
      de;+31
      j  com.cloudera.impala.planner.SingleNodePlanner.createSingleNodePlan()Lcom/cloudera/impala/planner/PlanNode;+87
      j  com.cloudera.impala.planner.Planner.createPlan()Ljava/util/ArrayList;+25
      J 2097 C2 com.cloudera.impala.service.Frontend.createExecRequest(Lcom/cloudera/impala/thrift/TQueryCtx;Ljava/lang/StringBuilder;)Lcom/cloudera/impala/thrift/TExecRequest; (1421 byte
      s) @ 0x00007f32f07be91c [0x00007f32f07bdc20+0xcfc]
      j  com.cloudera.impala.service.JniFrontend.createExecRequest([B)[B+30
      v  ~StubRoutines::call_stub
      V  [libjvm.so+0x5ffb65]  JavaCalls::call_helper(JavaValue*, methodHandle*, JavaCallArguments*, Thread*)+0x365
      V  [libjvm.so+0x5fe5c8]  JavaCalls::call(JavaValue*, methodHandle, JavaCallArguments*, Thread*)+0x28
      V  [libjvm.so+0x638dd4]  jni_invoke_nonstatic(JNIEnv_*, JavaValue*, _jobject*, JNICallType, _jmethodID*, JNI_ArgumentPusher*, Thread*)+0x2b4
      V  [libjvm.so+0x649ab9]  jni_CallObjectMethodV+0xe9
      C  [impalad+0xb47393]  JNIEnv_::CallObjectMethod(_jobject*, _jmethodID*, ...)+0xe3
      C  [impalad+0xe6fb55]  impala::Status impala::JniUtil::CallJniMethod<impala::TQueryCtx, impala::TExecRequest>(_jobject* const&, _jmethodID* const&, impala::TQueryCtx const&, impala::TExecRequest*)+0x17d
      C  [impalad+0xe6bfba]  impala::Frontend::GetExecRequest(impala::TQueryCtx const&, impala::TExecRequest*)+0x44
      C  [impalad+0xe8acd1]  impala::ImpalaServer::ExecuteInternal(impala::TQueryCtx const&, boost::shared_ptr<impala::ImpalaServer::SessionState>, bool*, boost::shared_ptr<impala::ImpalaServer::QueryExecState>*)+0x4b3
      C  [impalad+0xe8a713]  impala::ImpalaServer::Execute(impala::TQueryCtx*, boost::shared_ptr<impala::ImpalaServer::SessionState>, boost::shared_ptr<impala::ImpalaServer::QueryExecState>*)+0x11b
      C  [impalad+0xee5d31]  impala::ImpalaServer::ExecuteStatement(apache::hive::service::cli::thrift::TExecuteStatementResp&, apache::hive::service::cli::thrift::TExecuteStatementReq const&)+0xf87
      C  [impalad+0x10be72f]  apache::hive::service::cli::thrift::TCLIServiceProcessor::process_ExecuteStatement(int, apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*, void*)+0x247
      C  [impalad+0x10bcc50]  apache::hive::service::cli::thrift::TCLIServiceProcessor::dispatchCall(apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*, std::string const&, int, void*)+0x394
      C  [impalad+0x109397f]  impala::ImpalaHiveServer2ServiceProcessor::dispatchCall(apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*, std::string const&, int, void*)+0x9b
      C  [impalad+0xe9841a]  apache::thrift::TDispatchProcessor::process(boost::shared_ptr<apache::thrift::protocol::TProtocol>, boost::shared_ptr<apache::thrift::protocol::TProtocol>, void*)+0xd6
      

      I'll post the core/log files a little later.

      Attachments

        Activity

          People

            Unassigned Unassigned
            caseyc casey
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: