Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5131 Known issues with KRPC (IMPALA-2567)
  3. IMPALA-5566

Crash in impala::DataStreamSender::DataStreamSender

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • Impala 2.10.0
    • Distributed Exec
    • None
    • ghx-label-4

    Description

      Crash is happening using this build

      Server version: impalad version 2.10.0-SNAPSHOT RELEASE (build bfb159920e57bed1f83dbb55bccd9fd734294f10)
      

      Query

      select count(*) from orders group by o_orderdate
      

      Plan

      F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
      PLAN-ROOT SINK
      |  mem-estimate=0B mem-reservation=0B
      |
      04:EXCHANGE [UNPARTITIONED]
      |  mem-estimate=0B mem-reservation=0B
      |  tuple-ids=1 row-size=23B cardinality=2406
      |
      F01:PLAN FRAGMENT [HASH(o_orderdate)] hosts=132 instances=132
      03:AGGREGATE [FINALIZE]
      |  output: count:merge(*)
      |  group by: o_orderdate
      |  mem-estimate=10.00MB mem-reservation=264.00MB
      |  tuple-ids=1 row-size=23B cardinality=2406
      |
      02:EXCHANGE [HASH(o_orderdate)]
      |  mem-estimate=0B mem-reservation=0B
      |  tuple-ids=1 row-size=23B cardinality=2406
      |
      F00:PLAN FRAGMENT [RANDOM] hosts=132 instances=132
      01:AGGREGATE [STREAMING]
      |  output: count(*)
      |  group by: o_orderdate
      |  mem-estimate=10.00MB mem-reservation=0B
      |  tuple-ids=1 row-size=23B cardinality=2406
      |
      00:SCAN HDFS [tpch_10000_parquet.orders, RANDOM]
         partitions=2406/2406 files=4812 size=631.79GB
         stats-rows=15000000000 extrapolated-rows=disabled
         table stats: rows=15000000000 size=631.79GB
         column stats: all
         mem-estimate=0B mem-reservation=0B
         tuple-ids=0 row-size=15B cardinality=15000000000
      
      #0  0x0000003ea9e32625 in raise () from /lib64/libc.so.6
      #1  0x0000003ea9e33e05 in abort () from /lib64/libc.so.6
      #2  0x00007ff1816b809d in __gnu_cxx::__verbose_terminate_handler() () at ../../.././libstdc++-v3/libsupc++/vterminate.cc:95
      #3  0x00007ff1816b6106 in __cxxabiv1::__terminate(void (*)()) () at ../../.././libstdc++-v3/libsupc++/eh_terminate.cc:47
      #4  0x00007ff1816b6151 in std::terminate() () at ../../.././libstdc++-v3/libsupc++/eh_terminate.cc:57
      #5  0x00007ff1816b63b6 in __cxa_rethrow () at ../../.././libstdc++-v3/libsupc++/eh_throw.cc:125
      #6  0x0000000000fd3a2b in __shared_count<impala::DataStreamSender::Channel, std::allocator<impala::DataStreamSender::Channel>, impala::DataStreamSender*, impala::RowDescriptor const*&, impala::TNetworkAddress const&, impala::TUniqueId const&, int const&, int&> (this=Unhandled dwarf expression opcode 0xf3
      ) at /data/jenkins/workspace/impala-private-build-binaries/repos/Impala/toolchain/gcc-4.9.2/include/c++/4.9.2/bits/shared_ptr_base.h:626
      #7  __shared_ptr<std::allocator<impala::DataStreamSender::Channel>, impala::DataStreamSender*, impala::RowDescriptor const*&, impala::TNetworkAddress const&, impala::TUniqueId const&, int const&, int&> (
          this=Unhandled dwarf expression opcode 0xf3
      ) at /data/jenkins/workspace/impala-private-build-binaries/repos/Impala/toolchain/gcc-4.9.2/include/c++/4.9.2/bits/shared_ptr_base.h:1090
      #8  shared_ptr<std::allocator<impala::DataStreamSender::Channel>, impala::DataStreamSender*, impala::RowDescriptor const*&, impala::TNetworkAddress const&, impala::TUniqueId const&, int const&, int&> (
          this=Unhandled dwarf expression opcode 0xf3
      ) at /data/jenkins/workspace/impala-private-build-binaries/repos/Impala/toolchain/gcc-4.9.2/include/c++/4.9.2/bits/shared_ptr.h:316
      #9  allocate_shared<impala::DataStreamSender::Channel, std::allocator<impala::DataStreamSender::Channel>, impala::DataStreamSender*, impala::RowDescriptor const*&, impala::TNetworkAddress const&, impala::TUniqueId const&, int const&, int&> (this=Unhandled dwarf expression opcode 0xf3
      ) at /data/jenkins/workspace/impala-private-build-binaries/repos/Impala/toolchain/gcc-4.9.2/include/c++/4.9.2/bits/shared_ptr.h:588
      #10 make_shared<impala::DataStreamSender::Channel, impala::DataStreamSender*, impala::RowDescriptor const*&, impala::TNetworkAddress const&, impala::TUniqueId const&, int const&, int&> (this=Unhandled dwarf expression opcode 0xf3
      )
          at /data/jenkins/workspace/impala-private-build-binaries/repos/Impala/toolchain/gcc-4.9.2/include/c++/4.9.2/bits/shared_ptr.h:604
      #11 impala::DataStreamSender::DataStreamSender (this=Unhandled dwarf expression opcode 0xf3
      ) at /data/jenkins/workspace/impala-private-build-binaries/repos/Impala/be/src/runtime/data-stream-sender.cc:353
      #12 0x0000000000dd1368 in impala::DataSink::Create (fragment_ctx=..., fragment_instance_ctx=..., row_desc=0x12bbd860, state=0x12bbec00, sink=0x12cecd98)
          at /data/jenkins/workspace/impala-private-build-binaries/repos/Impala/be/src/exec/data-sink.cc:63
      #13 0x0000000000bdb92a in impala::FragmentInstanceState::Prepare (this=0x12cecc80) at /data/jenkins/workspace/impala-private-build-binaries/repos/Impala/be/src/runtime/fragment-instance-state.cc:196
      #14 0x0000000000bdc5a1 in impala::FragmentInstanceState::Exec (this=0x12cecc80) at /data/jenkins/workspace/impala-private-build-binaries/repos/Impala/be/src/runtime/fragment-instance-state.cc:81
      #15 0x0000000000bb9d36 in impala::QueryState::ExecFInstance (this=0x11806000, fis=0x12cecc80) at /data/jenkins/workspace/impala-private-build-binaries/repos/Impala/be/src/runtime/query-state.cc:333
      

      Attachments

        Activity

          People

            sailesh Sailesh Mukil
            mmokhtar Mostafa Mokhtar
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: