Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4350

Crash in PartitionedHashJoinNode::NodeDebugString() at log level 2

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Impala 2.7.0
    • Fix Version/s: Impala 2.8.0
    • Component/s: Backend
    • Labels:
      None

      Description

      Here is the stack:

      C [libExec.so+0x53706c] std::unique_ptr<impala::BufferedTupleStream, std::default_delete<impala::BufferedTupleStream> >::get() const+0x18
      C [libExec.so+0x54d6bc] impala::PartitionedHashJoinNode::NodeDebugString() const+0x296
      C [libExec.so+0x54d0bd] impala::PartitionedHashJoinNode::UpdateState(impala::PartitionedHashJoinNode::HashJoinState)+0x37f
      C [libExec.so+0x53eeb5] impala::PartitionedHashJoinNode::Open(impala::RuntimeState*)+0x793
      C [libExec.so+0x512fde] impala::PartitionedAggregationNode::Open(impala::RuntimeState*)+0x4b4
      C [libRuntime.so+0x53ff0e] impala::PlanFragmentExecutor::OpenInternal()+0x3ae
      C [libRuntime.so+0x53fa33] impala::PlanFragmentExecutor::Open()+0x229
      C [libService.so+0x30e7a8] impala::FragmentMgr::FragmentExecState::Exec()+0x66
      C [libService.so+0x31c0c8] impala::FragmentMgr::FragmentThread(impala::TUniqueId)+0x78
      C [libService.so+0x33863e] boost::_mfi::mf1<void, impala::FragmentMgr, impala::TUniqueId>::operator()(impala::FragmentMgr*, impala::TUniqueId) const+0x84
      C [libService.so+0x336c6b] void boost::_bi::list2<boost::_bi::value<impala::FragmentMgr*>, boost::_bi::value<impala::TUniqueId> >::operator()<boost::_mfi::mf1<void, impala::FragmentMgr, impala::TUniqueId>, boost::_bi::list0>(boost::_bi::type<void>, boost::_mfi::mf1<void, impala::FragmentMgr, impala::TUniqueId>&, boost::_bi::list0&, int)+0x7d
      C [libService.so+0x335557] boost::_bi::bind_t<void, boost::_mfi::mf1<void, impala::FragmentMgr, impala::TUniqueId>, boost::_bi::list2<boost::_bi::value<impala::FragmentMgr*>, boost::_bi::value<impala::TUniqueId> > >::operator()()+0x3b
      C [libService.so+0x33288c] boost::detail::function::void_function_obj_invoker0<boost::_bi::bind_t<void, boost::_mfi::mf1<void, impala::FragmentMgr, impala::TUniqueId>, boost::_bi::list2<boost::_bi::value<impala::FragmentMgr*>, boost::_bi::value<impala::TUniqueId> > >, void>::invoke(boost::detail::function::function_buffer&)+0x23
      C [libUtil.so+0x2e75f0] boost::function0<void>::operator()() const+0x52
      C [libUtil.so+0x2e6b97] impala::Thread::SuperviseThread(std::string const&, std::string const&, boost::function<void ()()>, impala::Promise<long>*)+0x2c5
      C [libUtil.so+0x2ee48e] void boost::_bi::list4<boost::_bi::value<std::string>, boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()()> >, boost::_bi::value<impala::Promise<long>> >::operator()<void (std::string const&, std::string const&, boost::function<void ()()>, impala::Promise<long>), boost::_bi::list0>(boost::_bi::type<void>, void (&)(std::string const&, std::string const&, boost::function<void ()()>, impala::Promise<long>), boost::_bi::list0&, int)+0xb2
      C [libUtil.so+0x2ee3d1] boost::_bi::bind_t<void, void (std::string const&, std::string const&, boost::function<void ()()>, impala::Promise<long>), boost::_bi::list4<boost::_bi::value<std::string>, boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()()> >, boost::_bi::value<impala::Promise<long>> > >::operator()()+0x3b
      C [libUtil.so+0x2ee32c] boost::detail::thread_data<boost::_bi::bind_t<void, void (std::string const&, std::string const&, boost::function<void ()()>, impala::Promise<long>), boost::_bi::list4<boost::_bi::value<std::string>, boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()()> >, boost::_bi::value<impala::Promise<long>> > > >::run()+0x1e

        Activity

        Hide
        tarmstrong Tim Armstrong added a comment -

        What query or tests were you running?

        Show
        tarmstrong Tim Armstrong added a comment - What query or tests were you running?
        Hide
        tarmstrong Tim Armstrong added a comment -

        IMPALA-4350: Crash with vlog level 2 in hash join node

        Testing:
        Reproduced by running test_mem_usage_scaling against an Impala with
        -v=2. Confirmed the fix avoided the crash.

        We don't have any routine testing of high log levels so there isn't
        a clear way to get good coverage of all code paths where there might be
        similar bugs.

        Change-Id: Ieedd49d8a17709177a622ddc15b78a3f48e12d3f
        Reviewed-on: http://gerrit.cloudera.org:8080/4830
        Reviewed-by: Tim Armstrong <tarmstrong@cloudera.com>
        Tested-by: Internal Jenkins

        Show
        tarmstrong Tim Armstrong added a comment - IMPALA-4350 : Crash with vlog level 2 in hash join node Testing: Reproduced by running test_mem_usage_scaling against an Impala with -v=2. Confirmed the fix avoided the crash. We don't have any routine testing of high log levels so there isn't a clear way to get good coverage of all code paths where there might be similar bugs. Change-Id: Ieedd49d8a17709177a622ddc15b78a3f48e12d3f Reviewed-on: http://gerrit.cloudera.org:8080/4830 Reviewed-by: Tim Armstrong <tarmstrong@cloudera.com> Tested-by: Internal Jenkins

          People

          • Assignee:
            tarmstrong Tim Armstrong
            Reporter:
            marcelk Marcel Kornacker
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development