[IMPALA-21] impalad coredumps running stress on rc/snappy table format in impala::SnappyBlockDecompressor::ProcessBlock ( ... ) at be/src/util/decompress.cc:213

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 0.4
• Fix Version/s: Impala 0.6
• Assignee: Nong Li
• Reporter: Lenni Kuff
• Created: 18/Jan/13 18:08
• Updated: 11/Feb/13 22:15
• Resolved: 11/Feb/13 22:15

Description

impalad coredumps running RC/Snappy stress (20 concurrent clients).

Stack trace:

#7  0x0000000000cf895e in impala::SnappyBlockDecompressor::ProcessBlock (
    this=0x910c240, input_length=215457, input=0x1a9fc06f "", 
    output_length=0xda26e6c, output=0x7f97944e2480)
    at /usr/src/debug/impala-0.4-SNAPSHOT/be/src/util/decompress.cc:213
#8  0x0000000000cb296c in impala::HdfsRCFileScanner::ReadKeyBuffers (
    this=0xda26d80)
    at /usr/src/debug/impala-0.4-SNAPSHOT/be/src/exec/hdfs-rcfile-scanner.cc:310
#9  0x0000000000cb1fc5 in impala::HdfsRCFileScanner::ReadRowGroup (
    this=0xda26d80)
---Type <return> to continue, or q <return> to quit---
    at /usr/src/debug/impala-0.4-SNAPSHOT/be/src/exec/hdfs-rcfile-scanner.cc:238
#10 0x0000000000cb3169 in impala::HdfsRCFileScanner::ProcessRange (
    this=0xda26d80)
    at /usr/src/debug/impala-0.4-SNAPSHOT/be/src/exec/hdfs-rcfile-scanner.cc:446
#11 0x0000000000ceb1e2 in impala::BaseSequenceScanner::ProcessScanRange (
    this=0xda26d80, context=0x1d2c8300)
    at /usr/src/debug/impala-0.4-SNAPSHOT/be/src/exec/base-sequence-scanner.cc:111
#12 0x0000000000c87bd5 in impala::HdfsScanNode::ScannerThread (this=0xce0c580, 
    scanner=0xda26d80, context=0x1d2c8300)
    at /usr/src/debug/impala-0.4-SNAPSHOT/be/src/exec/hdfs-scan-node.cc:646
#13 0x0000000000ca70ce in boost::_mfi::mf2<void, impala::HdfsScanNode, impala::HdfsScanner*, impala::ScanRangeContext*>::operator() (this=0x17de86b0, 
    p=0xce0c580, a1=0xda26d80, a2=0x1d2c8300)
    at /usr/include/boost/bind/mem_fn_template.hpp:274
#14 0x0000000000ca6f94 in boost::_bi::list3<boost::_bi::value<impala::HdfsScanNode*>, boost::_bi::value<impala::HdfsScanner*>, boost::_bi::value<impala::ScanRangeContext*> >::operator()<boost::_mfi::mf2<void, impala::HdfsScanNode, impala::HdfsScanner*, impala::ScanRangeContext*>, boost::_bi::list0> (this=0x17de86c0, 
    f=..., a=...) at /usr/include/boost/bind/bind.hpp:385
#15 0x0000000000ca6ebb in boost::_bi::bind_t<void, boost::_mfi::mf2<void, impala---Type <return> to continue, or q <return> to quit---
::HdfsScanNode, impala::HdfsScanner*, impala::ScanRangeContext*>, boost::_bi::list3<boost::_bi::value<impala::HdfsScanNode*>, boost::_bi::value<impala::HdfsScanner*>, boost::_bi::value<impala::ScanRangeContext*> > >::operator() (
    this=0x17de86b0) at /usr/include/boost/bind/bind_template.hpp:20
#16 0x0000000000ca6b40 in boost::detail::thread_data<boost::_bi::bind_t<void, boost::_mfi::mf2<void, impala::HdfsScanNode, impala::HdfsScanner*, impala::ScanRangeContext*>, boost::_bi::list3<boost::_bi::value<impala::HdfsScanNode*>, boost::_bi::value<impala::HdfsScanner*>, boost::_bi::value<impala::ScanRangeContext*> > > >::run (this=0x17de8580) at /usr/include/boost/thread/detail/thread.hpp:56
#17 0x0000000000d136fb in thread_proxy ()
#18 0x00000035dfe07851 in start_thread (arg=0x7f97944e3700)
    at pthread_create.c:301
#19 0x00000035df6e767d in clone ()
    at ../sysdeps/unix/sysv/linux/x86_64/clone.S:115

Core dumps/logs available:
http://sandbox.jenkins.cloudera.com/view/Impala/view/Cluster%20Runs/job/check-for-impala-coredumps-10node/208/