Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-1010

impalad crashes because of a use-after-free error in the ASAN build.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 1.4
    • Impala 1.4
    • None
    • None

    Description

      There are no core dumps, here's the stack:

      ==10626==ERROR: AddressSanitizer: heap-use-after-free on address 0x6210004f6100 at pc 0xe836f1 bp 0x7f3f757c4170 sp 0x7f3f757c4168
      READ of size 8 at 0x6210004f6100 thread T68925
          #0 0xe836f0 in impala::Tuple::DeepCopy(impala::TupleDescriptor const&, char**, int*, bool) /srv/jenkins/workspace/impala-master-64bit-multi/BUILD_TYPE/ASAN/label/impala/repos/Impala/be/src/runtime/tuple.cc:56
          #1 0xe7d4bb in impala::RowBatch::Serialize(impala::TRowBatch*) /srv/jenkins/workspace/impala-master-64bit-multi/BUILD_TYPE/ASAN/label/impala/repos/Impala/be/src/runtime/row-batch.cc:174
          #2 0x1577e4b in impala::DataStreamSender::Send(impala::RuntimeState*, impala::RowBatch*, bool) /srv/jenkins/workspace/impala-master-64bit-multi/BUILD_TYPE/ASAN/label/impala/repos/Impala/be/src/runtime/data-stream-sender.cc:430
          #3 0x13fb5f1 in impala::PlanFragmentExecutor::OpenInternal() /srv/jenkins/workspace/impala-master-64bit-multi/BUILD_TYPE/ASAN/label/impala/repos/Impala/be/src/runtime/plan-fragment-executor.cc:329
          #4 0x13fa5fd in impala::PlanFragmentExecutor::Open() /srv/jenkins/workspace/impala-master-64bit-multi/BUILD_TYPE/ASAN/label/impala/repos/Impala/be/src/runtime/plan-fragment-executor.cc:292
          #5 0xfb7d50 in impala::ImpalaServer::FragmentExecState::Exec() /srv/jenkins/workspace/impala-master-64bit-multi/BUILD_TYPE/ASAN/label/impala/repos/Impala/be/src/service/fragment-exec-state.cc:49
          #6 0xebc605 in impala::ImpalaServer::RunExecPlanFragment(impala::ImpalaServer::FragmentExecState*) /srv/jenkins/workspace/impala-master-64bit-multi/BUILD_TYPE/ASAN/label/impala/repos/Impala/be/src/service/impala-server.cc:1089
          #7 0xefa9a9 in boost::_bi::bind_t<void, boost::_mfi::mf1<void, impala::ImpalaServer, impala::ImpalaServer::FragmentExecState*>, boost::_bi::list2<boost::_bi::value<impala::ImpalaServer*>, boost::_bi::value<impala::ImpalaServer::FragmentExecState*> > >::operator()() /usr/include/boost/bind/bind_template.hpp:20
          #8 0xe18855 in boost::function0<void>::operator()() const /usr/include/boost/function/function_template.hpp:1012
          #9 0x10ac448 in impala::Thread::SuperviseThread(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, boost::function<void ()()>, impala::Promise<long>*) /srv/jenkins/workspace/impala-master-64bit-multi/BUILD_TYPE/ASAN/label/impala/repos/Impala/be/src/util/thread.cc:263
          #10 0x10b11bd in void boost::_bi::list4<boost::_bi::value<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, boost::_bi::value<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, boost::_bi::value<boost::function<void ()()> >, boost::_bi::value<impala::Promise<long>*> >::operator()<void (*)(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, boost::function<void ()()>, impala::Promise<long>*), boost::_bi::list0>(boost::_bi::type<void>, void (*&)(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, boost::function<void ()()>, impala::Promise<long>*), boost::_bi::list0&, int) /usr/include/boost/bind/bind.hpp:457
          #11 0x10b10b9 in boost::_bi::bind_t<void, void (*)(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, boost::function<void ()()>, impala::Promise<long>*), boost::_bi::list4<boost::_bi::value<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, boost::_bi::value<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, boost::_bi::value<boost::function<void ()()> >, boost::_bi::value<impala::Promise<long>*> > >::operator()() /usr/include/boost/bind/bind_template.hpp:20
          #12 0x15a75e3 in thread_proxy ??:0
          #13 0xd51013 in __asan::AsanThread::ThreadStart(unsigned long) ??:0
          #14 0x323a207850 in ?? ??:0
          #15 0x3239ae894c in ?? ??:0
      .
      .
      .
      0x6210004f6100 is located 107820835046084 bytes to the right#
      # A fatal error has been detected by the Java Runtime Environment:
      #
      #  SIGSEGV (0xb) at pc=0x0000000000d4c707, pid=10626, tid=139910530754304
      #
      # JRE version: 6.0_31-b04
      # Java VM: Java HotSpot(TM) 64-Bit Server VM (20.6-b01 mixed mode linux-amd64 compressed oops)
      # Problematic frame:
      # C  [impalad+0x94c707]  __asan::DescribeAddressRelativeToGlobal(unsigned long, unsigned long, __asan_global const&)+0xd7
      #
      # An error report file with more information is saved as:
      # /srv/jenkins/workspace/impala-master-64bit-multi/BUILD_TYPE/ASAN/label/impala/repos/Impala/hs_err_pid10626.log
      #
      # If you would like to submit a bug report, please visit:
      #   http://java.sun.com/webapps/bugreport/crash.jsp
      

      The change diff from the last successfull ASAN build is:

      Commit 7689a2cc265f1a0272d2dea85383b2229b30296e by jenkins
      IMPALA-996: Exclude non-materialized slots from a tuple's avgSerializedSize.
      
      Change-Id: Ic7936c6b5c5e6d4c162d91105128cda2b1b7284c
      Reviewed-on: http://gerrit.ent.cloudera.com:8080/2617
      Reviewed-by: Alex Behm <alex.behm@cloudera.com>
      Tested-by: jenkins
      

      Attachments

        Activity

          People

            nong_impala_60e1 Nong Li
            ishaan Ishaan Joshi
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: