Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4333

Crash in PlanRootSink::GetNext()

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 2.8.0
    • Impala 2.8.0
    • Backend
    • None

    Description

      Seen when using Hue (i.e. an HS2 client) with FETCH_FIRST:

      #5  <signal handler called>
      #6  0x00000033a5209470 in pthread_mutex_lock () from /lib64/libpthread.so.0
      #7  0x000000000081a608 in boost::mutex::lock() ()
      #8  0x000000000081a68c in boost::unique_lock<boost::mutex>::lock() ()
      #9  0x0000000000cf7d5d in impala::PlanRootSink::GetNext(impala::RuntimeState*, impala::QueryResultSet*, int, bool*) ()
      #10 0x0000000000da2398 in impala::Coordinator::GetNext(impala::QueryResultSet*, int, bool*) ()
      #11 0x0000000000af93c7 in impala::ImpalaServer::QueryExecState::FetchRowsInternal(int, impala::QueryResultSet*) ()
      #12 0x0000000000af96d9 in impala::ImpalaServer::QueryExecState::FetchRows(int, impala::QueryResultSet*) ()
      #13 0x0000000000ae1194 in impala::ImpalaServer::FetchInternal(impala::TUniqueId const&, int, bool, apache::hive::service::cli::thrift::TFetchResultsResp*) ()
      #14 0x0000000000ae1765 in impala::ImpalaServer::FetchResults(apache::hive::service::cli::thrift::TFetchResultsResp&, apache::hive::service::cli::thrift::TFetchResultsReq const&) ()
      #15 0x0000000000d4f54a in apache::hive::service::cli::thrift::TCLIServiceProcessor::process_FetchResults(int, apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*, void*) ()
      #16 0x0000000000d4af24 in apache::hive::service::cli::thrift::TCLIServiceProcessor::dispatchCall(apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*, std::string const&, int, void*) ()
      

      Here's a trace of the RPC requests made by Hue (most recent is last):

      root: DEBUG: Thrift call: <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.ExecuteStatement(args=(TExecuteStatementReq(confOverlay={'impala.resultset.cache.size': '50000', 'QUERY_TIMEOUT_S': '600'}, sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret='\r\xe59\xb0@2D\xfd\x8a\xb0z\xc7\x7f\xf8d\x14', guid='\xed\xb8G\x1fqpF\x86\xb68B\xec\x85\xf4\xee\x89')), runAsync=True, statement='SELECT * FROM tweets ORDER BY row_num'),), kwargs={})
      
      root: DEBUG: Thrift call <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.ExecuteStatement returned in 116ms: TExecuteStatementResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3', guid='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3')))
      
      root: DEBUG: Thrift call: <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.GetOperationStatus(args=(TGetOperationStatusReq(operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3', guid='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3'))),), kwargs={})
      
      root: DEBUG: Thrift call <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.GetOperationStatus returned in 65ms: TGetOperationStatusResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), operationState=1, errorMessage=None, sqlState=None, errorCode=None)
      
      root: DEBUG: Thrift call: <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.GetOperationStatus(args=(TGetOperationStatusReq(operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3', guid='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3'))),), kwargs={})
      
      root: DEBUG: Thrift call <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.GetOperationStatus returned in 64ms: TGetOperationStatusResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), operationState=2, errorMessage=None, sqlState=None, errorCode=None)
      
      root: DEBUG: Thrift call: <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.GetLog(args=(TGetLogReq(operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3', guid='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3'))),), kwargs={})
      
      root: DEBUG: Thrift call <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.GetLog returned in 69ms: TGetLogResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), log='Query dc4519afdcc44dee:b324ca9700000000 100% Complete (5 out of 5)\n')
      access: INFO: 127.0.0.1 test - "GET /impala/results/3/0 HTTP/1.1"
      
      root: DEBUG: Thrift call: <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.GetOperationStatus(args=(TGetOperationStatusReq(operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3', guid='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3'))),), kwargs={})
      
      root: DEBUG: Thrift call <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.GetOperationStatus returned in 62ms: TGetOperationStatusResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), operationState=2, errorMessage=None, sqlState=None, errorCode=None)
      
      root: DEBUG: Thrift call: <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.FetchResults(args=(TFetchResultsReq(fetchType=0, operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3', guid='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3')), orientation=4, maxRows=100),), kwargs={})
      
      root: DEBUG: Thrift call <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.FetchResults returned in 72ms: TFetchResultsResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), results=TRowSet(rows=[], columns=[TColumn(i32Val=TI32Column(nulls='\x00', values=[1, 2, 3, 4, 5]), byteVal=None, i16Val=None, i64Val=None, stringVal=None, boolVal=None, doubleVal=None, binaryVal=None), TColumn(i32Val=None, byteVal=None, i16Val=None, i64Val=None, stringVal=TStringColumn(nulls='\x00', values=['531091827395682000', '531091827781550000', '531091827768979000', '531091827114668000', '531091827949309000']), boolVal=None, doubleVal=None, binaryVal=None), TColumn(i32Val=None, byteVal=None, i16Val=None, i64Val=None, stringVal=TStringColumn(nulls='\x00', values=['My dad looks younger than costa', 'There is a thin line between your partner being vengeful and you reaping the consequences of your bad actions towards your partner.', '@Mustang_Sally83 and they need to get into you :))))', '@RachelZJohnson thank you rach!xxx', 'i think @WWERollins was robbed of the IC ti...
      
      root: DEBUG: Thrift call: <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.GetResultSetMetadata(args=(TGetResultSetMetadataReq(operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3', guid='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3'))),), kwargs={})
      
      root: DEBUG: Thrift call <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.GetResultSetMetadata returned in 65ms: TGetResultSetMetadataResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), schema=TTableSchema(columns=[TColumnDesc(comment=None, columnName='row_num', typeDesc=TTypeDesc(types=[TTypeEntry(mapEntry=None, unionEntry=None, arrayEntry=None, userDefinedTypeEntry=None, structEntry=None, primitiveEntry=TPrimitiveTypeEntry(typeQualifiers=None, type=3))]), position=0), TColumnDesc(comment=None, columnName='id_str', typeDesc=TTypeDesc(types=[TTypeEntry(mapEntry=None, unionEntry=None, arrayEntry=None, userDefinedTypeEntry=None, structEntry=None, primitiveEntry=TPrimitiveTypeEntry(typeQualifiers=None, type=7))]), position=1), TColumnDesc(comment=None, columnName='text', typeDesc=TTypeDesc(types=[TTypeEntry(mapEntry=None, unionEntry=None, arrayEntry=None, userDefinedTypeEntry=None, structEntry=None, primitiveEntry=TPrimitiveTypeEntry(typeQualifiers=None, type=7))]), position=2)]))
      
      root: DEBUG: Thrift call: <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.GetLog(args=(TGetLogReq(operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3', guid='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3'))),), kwargs={})
      
      root: DEBUG: Thrift call <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.GetLog returned in 66ms: TGetLogResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), log='Query dc4519afdcc44dee:b324ca9700000000 100% Complete (5 out of 5)\n')
      access: INFO: 127.0.0.1 test - "GET /impala/results/3/0 HTTP/1.1"
      
      root: DEBUG: Thrift call: <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.GetOperationStatus(args=(TGetOperationStatusReq(operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3', guid='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3'))),), kwargs={})
      
      root: DEBUG: Thrift call <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.GetOperationStatus returned in 70ms: TGetOperationStatusResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), operationState=2, errorMessage=None, sqlState=None, errorCode=None)
      
      root: DEBUG: Thrift call: <class 'ImpalaService.ImpalaHiveServer2Service.Client'>.FetchResults(args=(TFetchResultsReq(fetchType=0, operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3', guid='\xeeM\xc4\xdc\xaf\x19E\xdc\x00\x00\x00\x00\x97\xca$\xb3')), orientation=4, maxRows=100),), kwargs={})
      

      Attachments

        Issue Links

          Activity

            People

              henryr Henry Robinson
              henryr Henry Robinson
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: