Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-228

Selecting from a parquetfile table that contains a string partition column results in segfault:

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 0.7
    • Impala 0.7
    • None
    • None

    Description

      this might be related to IMPALA-226... selecting from a parquetfile table that contains a string partition column results in segfault.

      Repro

      [localhost:21000] > create table p (i int) partitioned by (s string) stored as parquetfile
      [localhost:21000] > alter table p add partition (s='a')
      [localhost:21000] > insert into p partition (s='a') select 1 from functional.alltypes
      Query: insert into p partition (s='a') select 1 from functional.alltypes
      Inserted 7300 rows in 0.72s
      [localhost:21000] > select * from p limit 10;
      Query: select * from p limit 10
      Query finished, fetching results ...
      Error communicating with impalad: None
      
      #7  0x00007f5ffa311f2b in std::basic_string<char, std::char_traits<char>, std::allocator<char> >::basic_string(std::string const&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
      #8  0x0000000000ae8ef7 in std::_Construct<std::string, std::string> (__p=0x49b44f8, __value=...)
          at /usr/include/c++/4.6/bits/stl_construct.h:84
      #9  0x0000000000ae8c7c in std::__uninitialized_copy<false>::__uninit_copy<__gnu_cxx::__normal_iterator<std::string const*, std::vector<std::string, std::allocator<std::string> > >, std::string*> (__first=..., __last=..., 
          __result=0x49b44f8) at /usr/include/c++/4.6/bits/stl_uninitialized.h:77
      #10 0x0000000000ae8701 in std::uninitialized_copy<__gnu_cxx::__normal_iterator<std::string const*, std::vector<std::string, std::allocator<std::string> > >, std::string*> (__first=..., __last=..., __result=0x49b44f8)
          at /usr/include/c++/4.6/bits/stl_uninitialized.h:119
      #11 0x0000000000ae7904 in std::__uninitialized_copy_a<__gnu_cxx::__normal_iterator<std::string const*, std::vector<std::string, std::allocator<std::string> > >, std::string*, std::string> (__first=..., __last=..., 
          __result=0x49b44f8) at /usr/include/c++/4.6/bits/stl_uninitialized.h:259
      #12 0x0000000000ae6e99 in std::vector<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::basic_string<char, std::char_traits<char>, std::allocator<char> > > >::vector (
          this=0x21c4b5a8, __x=...) at /usr/include/c++/4.6/bits/stl_vector.h:280
      #13 0x0000000000ae5b45 in impala::Status::ErrorDetail::ErrorDetail (this=0x21c4b5a0)
          at /home/lskuff/dev/Impala/be/src/common/status.h:147
      #14 0x0000000000ae5c26 in impala::Status::operator= (this=0x40b0f58, status=...)
          at /home/lskuff/dev/Impala/be/src/common/status.h:85
      #15 0x0000000000c69978 in impala::Coordinator::CancelInternal (this=0x40b0c00)
          at /home/lskuff/dev/Impala/be/src/runtime/coordinator.cc:834
      #16 0x0000000000c6985c in impala::Coordinator::CancelInternal (this=0x3234000)
          at /home/lskuff/dev/Impala/be/src/runtime/coordinator.cc:833
      #17 0x0000000000c65691 in impala::Coordinator::UpdateStatus (this=0x3234000, status=..., instance_id=0x3369000)
          at /home/lskuff/dev/Impala/be/src/runtime/coordinator.cc:442
      #18 0x0000000000c6ae45 in impala::Coordinator::UpdateFragmentExecStatus (this=0x3234000, params=...)
          at /home/lskuff/dev/Impala/be/src/runtime/coordinator.cc:983
      #19 0x0000000000aff021 in impala::ImpalaServer::ReportExecStatus (this=0x307e800, return_val=..., params=...)
          at /home/lskuff/dev/Impala/be/src/service/impala-server.cc:1610
      #20 0x0000000000d1e696 in impala::ImpalaInternalServiceProcessor::process_ExecPlanFragment (this=0x105c17780, 
          seqid=32607, iprot=0xb64ecd, oprot=0x7f5fda2267e0, callContext=0x5fe1310)
          at /home/lskuff/dev/Impala/be/generated-sources/gen-cpp/ImpalaInternalService.cpp:959
      #21 0x0000000000d1dc8b in impala::ImpalaInternalServiceClient::recv_TransmitData (this=0x5c17740, _return=...)
          at /home/lskuff/dev/Impala/be/generated-sources/gen-cpp/ImpalaInternalService.cpp:882
      #22 0x0000000000b0677c in apache::thrift::TDispatchProcessor::process (this=0x313ec00, in=..., out=..., 
          connectionContext=0x1821c238)
          at /home/lskuff/dev/Impala/thirdparty/thrift-0.9.0/build/include/thrift/TDispatchProcessor.h:121
      #23 0x00000000016b680d in _M_lower_bound (__k=<optimized out>, __y=<optimized out>, __x=0x390d4c0, 
          this=<optimized out>) at /usr/include/c++/4.6/bits/stl_tree.h:1089
      #24 equal_range (__k=@0x20ac010: 0xfffffffffffffffe, this=0x5dbf400)
          at /usr/include/c++/4.6/bits/stl_tree.h:1169
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            lskuff Lenni Kuff
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: