Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5889

Segmentation fault in ScannerContext::Stream::GetBytesInternal(long, unsigned char**, bool, long*)

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Duplicate
    • Affects Version/s: Impala 2.8.0, Impala 2.9.0
    • Fix Version/s: None
    • Component/s: Backend
    • Labels:
    • Epic Color:
      ghx-label-8

      Description

      I found several crashes like this one while looking at minidumps from a private cluster. Below is the stack of the crashing thread. I'll also attach a full resolved minidump. I suspect that this happened while Impala was scanning an Avro file while it was being overwritten. I tried to reproduce this but couldn't do so. I also suspect this could be related to IMPALA-4223.

      Crash reason:  SIGSEGV
      Crash address: 0x7fc302e12000
      Process uptime: not available
      
      Thread 587 (crashed)
       0  libc-2.12.so + 0x8995f
          Found by: given as instruction pointer in context
       1  impalad!impala::ScannerContext::Stream::GetBytesInternal(long, unsigned char**, bool, long*) [string-buffer.h : 54 + 0x12]
          Found by: stack scanning
       2  impalad!impala::BaseSequenceScanner::SkipToSync(unsigned char const*, int) [scanner-context.inline.h : 55 + 0x19]
          Found by: call frame info
       3  impalad!impala::BaseSequenceScanner::ProcessSplit() [base-sequence-scanner.cc : 199 + 0x10]
          Found by: call frame info
       4  impalad!impala::HdfsScanNode::ProcessSplit(std::vector<impala::FilterContext, std::allocator<impala::FilterContext> > const&, impala::DiskIoMgr::ScanRange*) [hdfs-scan-node.cc : 526 + 0x11]
          Found by: call frame info
       5  impalad!impala::HdfsScanNode::ScannerThread() [hdfs-scan-node.cc : 417 + 0x18]
          Found by: call frame info
       6  impalad!impala::Thread::SuperviseThread(std::string const&, std::string const&, boost::function<void ()>, impala::Promise<long>*) [function_template.hpp : 767 + 0x7]
          Found by: call frame info
       7  impalad!boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(std::string const&, std::string const&, boost::function<void ()>, impala::Promise<long>*), boost::_bi::list4<boost::_bi::value<std::string>, boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()> >, boost::_bi::value<impala::Promise<long>*> > > >::run() [bind.hpp : 457 + 0x6]
          Found by: call frame info
       8  impalad!thread_proxy + 0xda
          Found by: call frame info
       9  libpthread-2.12.so + 0x7aa1
          Found by: call frame info
      10  libc-2.12.so + 0xe893d
          Found by: stack scanning
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                lv Lars Volker
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: