Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-1844

Codegen crash while optimizing module for fragment for compute stats

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Works for Me
    • Affects Version/s: Impala 2.2
    • Fix Version/s: Impala 2.2
    • Component/s: None
    • Labels:
      None

      Description

      This came up while investigating another issue. I'm pretty sure its unrelated though and it has only come up once.

      (gdb) bt
      #0  0x00007f7a49347e37 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
      #1  0x00007f7a49349528 in __GI_abort () at abort.c:89
      #2  0x00007f7a48529cf5 in os::abort(bool) ()
         from /usr/lib/jvm/java-7-oracle/jre/lib/amd64/server/libjvm.so
      #3  0x00007f7a486ab4f7 in VMError::report_and_die() ()
         from /usr/lib/jvm/java-7-oracle/jre/lib/amd64/server/libjvm.so
      #4  0x00007f7a4852ec0f in JVM_handle_linux_signal ()
         from /usr/lib/jvm/java-7-oracle/jre/lib/amd64/server/libjvm.so
      #5  <signal handler called>
      #6  0x0000000001fe5e03 in llvm::StringMapImpl::FindKey(llvm::StringRef) const ()
      #7  0x0000000001fe5f09 in llvm::StringMapImpl::RemoveKey(llvm::StringRef) ()
      #8  0x0000000001fe5f83 in llvm::StringMapImpl::RemoveKey(llvm::StringMapEntryBase*) ()
      #9  0x0000000001ed6e99 in void llvm::SymbolTableListTraits<llvm::Instruction, llvm::BasicBlock>::setSymTabObject<llvm::Function*>(llvm::Function**, llvm::Function*) ()
      #10 0x0000000001ed61c8 in llvm::BasicBlock::setParent(llvm::Function*) ()
      #11 0x0000000001ed6226 in llvm::BasicBlock::eraseFromParent() ()
      #12 0x0000000001f0bd6a in llvm::Function::dropAllReferences() ()
      #13 0x00000000016f2839 in (anonymous namespace)::GlobalDCE::runOnModule(llvm::Module&) ()
      #14 0x0000000001f7ac0b in llvm::MPPassManager::runOnModule(llvm::Module&) ()
      #15 0x0000000001f7adef in llvm::PassManagerImpl::run(llvm::Module&) ()
      #16 0x0000000000eecc2b in impala::LlvmCodeGen::OptimizeModule (this=0x8a74b00)
          at /home/casey/Impala/be/src/codegen/llvm-codegen.cc:680
      #17 0x0000000000eec441 in impala::LlvmCodeGen::FinalizeModule (this=0x8a74b00)
          at /home/casey/Impala/be/src/codegen/llvm-codegen.cc:622
      #18 0x00000000014fc410 in impala::PlanFragmentExecutor::OptimizeLlvmModule (this=0x10149810)
          at /home/casey/Impala/be/src/runtime/plan-fragment-executor.cc:273
      #19 0x00000000014fcf00 in impala::PlanFragmentExecutor::Open (this=0x10149810)
          at /home/casey/Impala/be/src/runtime/plan-fragment-executor.cc:315
      #20 0x0000000001135813 in impala::FragmentMgr::FragmentExecState::Exec (this=0x10149600)
          at /home/casey/Impala/be/src/service/fragment-exec-state.cc:49
      #21 0x000000000112cc13 in impala::FragmentMgr::FragmentExecThread (this=0x9272480, 
          exec_state=0x10149600) at /home/casey/Impala/be/src/service/fragment-mgr.cc:70
      #22 0x00000000011312c8 in boost::_mfi::mf1<void, impala::FragmentMgr, impala::FragmentMgr::FragmentExecState*>::operator() (this=0x7183020, p=0x9272480, a1=0x10149600)
          at /usr/include/boost/bind/mem_fn_template.hpp:165
      

      this happend while running the test below

      casey@casey-desktop:~/Impala/tests/query_test$ py.test -k test_low_mem_limit_q3
      ========================================= test session starts ==========================================
      platform linux2 -- Python 2.7.8 -- py-1.4.24 -- pytest-2.6.2 -- /usr/bin/python
      plugins: xdist
      collected 899 items 
      
      test_mem_usage_scaling.py::TestTpchMemLimitError::test_low_mem_limit_q3[mem_limit: 100 | exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: parquet/none] ERROR
      
      ================================================ ERRORS ================================================
       ERROR at setup of TestTpchMemLimitError.test_low_mem_limit_q3[mem_limit: 100 | exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: parquet/none] 
      test_mem_usage_scaling.py:107: in setup_class
          cls.client.execute('compute stats tpch_parquet.lineitem');
      ../common/impala_connection.py:159: in execute
          return self.__beeswax_client.execute(sql_stmt, user=user)
      ../beeswax/impala_beeswax.py:163: in execute
          handle = self.__execute_query(query_string.strip(), user=user)
      ../beeswax/impala_beeswax.py:316: in __execute_query
          self.wait_for_completion(handle)
      ../beeswax/impala_beeswax.py:335: in wait_for_completion
          raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
      E   ImpalaBeeswaxException: ImpalaBeeswaxException:
      E    Query aborted:Cancelled due to unreachable impalad(s): casey-desktop:22001
      ---------------------------------------- Captured stderr setup -----------------------------------------
      -- connecting to: localhost:21000
      -- executing against localhost:21000
      compute stats tpch_parquet.lineitem;
      
      ======================================= short test summary info ========================================
      ERROR test_mem_usage_scaling.py::TestTpchMemLimitError::()::test_low_mem_limit_q3[mem_limit: 100 | exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: parquet/none]
      !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Interrupted: stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
      ========================== 889 tests deselected by '-ktest_low_mem_limit_q3' ===========================
      ======================== 889 deselected, 74 warnings, 1 error in 15.57 seconds =========================
      

        Attachments

          Activity

            People

            • Assignee:
              skye Skye Wanderman-Milne
              Reporter:
              caseyc casey
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: