[IMPALA-5876] Segmentation fault in HdfsAvroScanner::MaterializeTuple(impala::AvroSchemaElement const&, impala::MemPool*, unsigned char**, unsigned char*, impala::Tuple*)

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Duplicate
• Affects Version/s: Impala 2.9.0
• Component/s: Backend
• Labels: crash
• Target Version: Impala 2.11.0
• Epic Color: ghx-label-7
• Assignee: Thomas Tauber-Marshall
• Reporter: Lars Volker
• Created: 31/Aug/17 21:11
• Updated: 01/Sep/17 21:18
• Resolved: 01/Sep/17 21:18

Description

This could be a null pointer dereference in be/src/exec/hdfs-avro-scanner.cc:581:

    avro_type_t type = element.schema->type;

Here is the stack trace of the crashing thread from a minidump. Please reach out if you want to access the full minidump. I may also be able to provide a core file.

Crash reason:  SIGSEGV
Crash address: 0x0

 0  impalad!impala::HdfsAvroScanner::MaterializeTuple(impala::AvroSchemaElement const&, impala::MemPool*, unsigned char**, unsigned char*, impala::Tuple*) [hdfs-avro-scanner.cc : 589 + 0x0]
 1  impalad!impala::HdfsAvroScanner::DecodeAvroData(int, impala::MemPool*, unsigned char**, unsigned char*, impala::Tuple*, impala::TupleRow*) [hdfs-avro-scanner-ir.cc : 40 + 0x5]
 2  impalad!impala::HdfsAvroScanner::ProcessRange() [hdfs-avro-scanner.cc : 553 + 0x30]
 3  impalad!impala::BaseSequenceScanner::ProcessSplit() [base-sequence-scanner.cc : 181 + 0xd]
 4  impalad!impala::HdfsScanNode::ProcessSplit(std::vector<impala::FilterContext, std::allocator<impala::FilterContext> > const&, impala::DiskIoMgr::ScanRange*) [hdfs-scan-node.cc : 526 + 0x11]
 5  impalad!impala::HdfsScanNode::ScannerThread() [hdfs-scan-node.cc : 417 + 0x18]
 6  impalad!impala::Thread::SuperviseThread(std::string const&, std::string const&, boost::function<void ()>, impala::Promise<long>*) [function_template.hpp : 767 + 0x7]
 7  impalad!boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(std::string const&, std::string const&, boost::function<void ()>, impala::Promise<long>*), boost::_bi::list4<boost::_bi::value<std::string>, boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()> >, boost::_bi::value<impala::Promise<long>*> > > >::run() [bind.hpp :      457 + 0x6]
 8  impalad!thread_proxy + 0xda
 9  libpthread-2.12.so + 0x7aa1
10  libc-2.12.so + 0xe893d

Issue Links

• duplicates: IMPALA-5884 Impala daemon crashes during attempted clean shutdown