[IMPALA-3539] Stress test hit DCHECK in Parquet scanner hdfs-parquet-scanner.cc:1587] Check failed: batch_size <= cache_size_ (1024 vs. 0)

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 2.6.0
• Fix Version/s: Impala 2.6.0
• Component/s: Backend
• Labels: crash stress
• Target Version: Impala 2.6.0
• Assignee: Alexander Behm
• Reporter: Tim Armstrong
• Created: 13/May/16 17:51
• Updated: 14/May/16 02:20
• Resolved: 14/May/16 02:20

Description

I'll collect more info but the DCHECK may be enough to diagnose.

F0513 10:21:13.208798 100640 hdfs-parquet-scanner.cc:1587] Check failed: batch_size <= cache_size_ (1024 vs. 0) 
*** Check failure stack trace: ***
    @          0x27bc5ed  google::LogMessage::Fail()
    @          0x27bef16  google::LogMessage::SendToLog()
    @          0x27bc10d  google::LogMessage::Flush()
    @          0x27bf9be  google::LogMessageFatal::~LogMessageFatal()
    @          0x15c88dc  impala::HdfsParquetScanner::LevelDecoder::CacheNextBatch()
    @          0x15f71cf  impala::HdfsParquetScanner::ScalarColumnReader<>::ReadValueBatch<>()
    @          0x15edc92  impala::HdfsParquetScanner::ScalarColumnReader<>::ReadValueBatch()
    @          0x15cc1c5  impala::HdfsParquetScanner::AssembleRows()
    @          0x15ca9ea  impala::HdfsParquetScanner::ProcessSplit()
    @          0x15814a4  impala::HdfsScanNode::ProcessSplit()
    @          0x1580579  impala::HdfsScanNode::ScannerThread()
    @          0x159c6e3  boost::_mfi::mf0<>::operator()()
    @          0x159b866  boost::_bi::list1<>::operator()<>()
    @          0x159a315  boost::_bi::bind_t<>::operator()()
    @          0x159813c  boost::detail::function::void_function_obj_invoker0<>::invoke()
    @          0x124f77c  boost::function0<>::operator()()
    @          0x14ecc3d  impala::Thread::SuperviseThread()
    @          0x14f37a0  boost::_bi::list4<>::operator()<>()
    @          0x14f36e3  boost::_bi::bind_t<>::operator()()
    @          0x14f36a6  boost::detail::thread_data<>::run()
    @          0x192d19a  thread_proxy
    @       0x39c68079d1  (unknown)
    @       0x39c64e88fd  (unknown)
Picked up JAVA_TOOL_OPTIONS: