Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4532

Crashes in impala::ThreadCounterMeasurement::Stop()

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 2.8.0
    • Impala 2.8.0
    • Backend

    Description

      Hit the following crash when running exhaustive test. It looks as if the execution somehow jumped to 0xffffffff due to broken vptr table.

      CORE: ./core.1479914598.27789.impalad
      BINARY: ./be/build/latest/service/impalad
      Core was generated by `/data/jenkins/workspace/impala-private-build-and-test/repos/Impala/be/build/lat'.
      Program terminated with signal 6, Aborted.
      #0  0x0000003861a328e5 in raise () from /lib64/libc.so.6
      To enable execution of this file add
              add-auto-load-safe-path /data/jenkins/workspace/impala-private-build-and-test/Impala-Toolchain/gcc-4.9.2/lib64/libstdc++.so.6.0.20-gdb.py
      line to your configuration file "/var/lib/jenkins/.gdbinit".
      To completely disable this security protection add
              set auto-load safe-path /
      line to your configuration file "/var/lib/jenkins/.gdbinit".
      For more information about this security protection see the
      "Auto-loading safe path" section in the GDB manual.  E.g., run from the shell:
              info "(gdb)Auto-loading safe path"
      #0  0x0000003861a328e5 in raise () from /lib64/libc.so.6
      #1  0x0000003861a340c5 in abort () from /lib64/libc.so.6
      #2  0x00007f8ed7a6cc55 in os::abort(bool) () from /opt/toolchain/sun-jdk-64bit-1.7.0.75/jre/lib/amd64/server/libjvm.so
      #3  0x00007f8ed7beecd7 in VMError::report_and_die() () from /opt/toolchain/sun-jdk-64bit-1.7.0.75/jre/lib/amd64/server/libjvm.so
      #4  0x00007f8ed7a71b6f in JVM_handle_linux_signal () from /opt/toolchain/sun-jdk-64bit-1.7.0.75/jre/lib/amd64/server/libjvm.so
      #5  <signal handler called>
      #6  0x00000000ffffffff in ?? ()
      #7  0x0000000001682cac in impala::ThreadCounterMeasurement::Stop (this=0x7f8e056ad780) at /data/jenkins/workspace/impala-private-build-and-test/repos/Impala/be/src/util/runtime-profile-counters.h:517
      #8  0x0000000001682dd8 in impala::ThreadCounterMeasurement::~ThreadCounterMeasurement (this=0x7f8e056ad780, __in_chrg=<value optimized out>) at /data/jenkins/workspace/impala-private-build-and-test/repos/Impala/be/src/util/runtime-profile-counters.h:527
      #9  0x00000000017c0902 in impala::BlockingJoinNode::ProcessBuildInputAsync (this=0x1dde3f80, state=0xc135b00, build_sink=0xd848a00, status=0x7f8df40198e0) at /data/jenkins/workspace/impala-private-build-and-test/repos/Impala/be/src/exec/blocking-join-node.cc:167
      #10 0x00000000017c4059 in boost::_mfi::mf3<void, impala::BlockingJoinNode, impala::RuntimeState*, impala::DataSink*, impala::Promise<impala::Status>*>::operator() (this=0xa1bf500, p=0x1dde3f80, a1=0xc135b00, a2=0xd848a00, a3=0x7f8df40198e0) at /data/jenkins/workspace/impala-private-build-and-test/Impala-Toolchain/boost-1.57.0/include/boost/bind/mem_fn_template.hpp:393
      #11 0x00000000017c3f05 in boost::_bi::list4<boost::_bi::value<impala::BlockingJoinNode*>, boost::_bi::value<impala::RuntimeState*>, boost::_bi::value<impala::DataSink*>, boost::_bi::value<impala::Promise<impala::Status>*> >::operator()<boost::_mfi::mf3<void, impala::BlockingJoinNode, impala::RuntimeState*, impala::DataSink*, impala::Promise<impala::Status>*>, boost::_bi::list0> (this=0xa1bf510, f=..., a=...) at /data/jenkins/workspace/impala-private-build-and-test/Impala-Toolchain/boost-1.57.0/include/boost/bind/bind.hpp:457
      #12 0x00000000017c3c51 in boost::_bi::bind_t<void, boost::_mfi::mf3<void, impala::BlockingJoinNode, impala::RuntimeState*, impala::DataSink*, impala::Promise<impala::Status>*>, boost::_bi::list4<boost::_bi::value<impala::BlockingJoinNode*>, boost::_bi::value<impala::RuntimeState*>, boost::_bi::value<impala::DataSink*>, boost::_bi::value<impala::Promise<impala::Status>*> > >::operator() (this=0xa1bf500) at /data/jenkins/workspace/impala-private-build-and-test/Impala-Toolchain/boost-1.57.0/include/boost/bind/bind_template.hpp:20
      #13 0x00000000017c394a in boost::detail::function::void_function_obj_invoker0<boost::_bi::bind_t<void, boost::_mfi::mf3<void, impala::BlockingJoinNode, impala::RuntimeState*, impala::DataSink*, impala::Promise<impala::Status>*>, boost::_bi::list4<boost::_bi::value<impala::BlockingJoinNode*>, boost::_bi::value<impala::RuntimeState*>, boost::_bi::value<impala::DataSink*>, boost::_bi::value<impala::Promise<impala::Status>*> > >, void>::invoke (function_obj_ptr=...) at /data/jenkins/workspace/impala-private-build-and-test/Impala-Toolchain/boost-1.57.0/include/boost/function/function_template.hpp:153
      #14 0x0000000001340c56 in boost::function0<void>::operator() (this=0x7f8e056adc40) at /data/jenkins/workspace/impala-private-build-and-test/Impala-Toolchain/boost-1.57.0/include/boost/function/function_template.hpp:767
      #15 0x00000000015ed929 in impala::Thread::SuperviseThread (name=..., category=..., functor=..., thread_started=0x7f8df40196d0) at /data/jenkins/workspace/impala-private-build-and-test/repos/Impala/be/src/util/thread.cc:317
      #16 0x00000000015f4902 in boost::_bi::list4<boost::_bi::value<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, boost::_bi::value<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, boost::_bi::value<boost::function<void()> >, boost::_bi::value<impala::Promise<long int>*> >::operator()<void (*)(const std::basic_string<char>&, const std::basic_string<char>&, boost::function<void()>, impala::Promise<long int>*), boost::_bi::list0>(boost::_bi::type<void>, void (*&)(const std::basic_string<char, std::char_traits<char>, std::allocator<char> > &, const std::basic_string<char, std::char_traits<char>, std::allocator<char> > &, boost::function<void()>, impala::Promise<long> *), boost::_bi::list0 &, int) (this=0xa2161c0, f=@0xa2161b8, a=...) at /data/jenkins/workspace/impala-private-build-and-test/Impala-Toolchain/boost-1.57.0/include/boost/bind/bind.hpp:457
      #17 0x00000000015f4845 in boost::_bi::bind_t<void, void (*)(const std::basic_string<char, std::char_traits<char>, std::allocator<char> >&, const std::basic_string<char, std::char_traits<char>, std::allocator<char> >&, boost::function<void()>, impala::Promise<long int>*), boost::_bi::list4<boost::_bi::value<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, boost::_bi::value<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, boost::_bi::value<boost::function<void()> >, boost::_bi::value<impala::Promise<long int>*> > >::operator()(void) (this=0xa2161b8) at /data/jenkins/workspace/impala-private-build-and-test/Impala-Toolchain/boost-1.57.0/include/boost/bind/bind_template.hpp:20
      #18 0x00000000015f47a0 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(const std::basic_string<char, std::char_traits<char>, std::allocator<char> >&, const std::basic_string<char, std::char_traits<char>, std::allocator<char> >&, boost::function<void()>, impala::Promise<long int>*), boost::_bi::list4<boost::_bi::value<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, boost::_bi::value<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, boost::_bi::value<boost::function<void()> >, boost::_bi::value<impala::Promise<long int>*> > > >::run(void) (this=0xa216000) at /data/jenkins/workspace/impala-private-build-and-test/Impala-Toolchain/boost-1.57.0/include/boost/thread/detail/thread.hpp:116
      #19 0x0000000001a42cfa in thread_proxy ()
      #20 0x0000003861e07851 in start_thread () from /lib64/libpthread.so.0
      #21 0x0000003861ae894d in clone () from /lib64/libc.so.6
      

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            kwho Michael Ho
            kwho Michael Ho
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment