Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3539

Stress test hit DCHECK in Parquet scanner hdfs-parquet-scanner.cc:1587] Check failed: batch_size <= cache_size_ (1024 vs. 0)

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: Impala 2.6.0
    • Fix Version/s: Impala 2.6.0
    • Component/s: Backend
    • Labels:

      Description

      I'll collect more info but the DCHECK may be enough to diagnose.

      F0513 10:21:13.208798 100640 hdfs-parquet-scanner.cc:1587] Check failed: batch_size <= cache_size_ (1024 vs. 0) 
      *** Check failure stack trace: ***
          @          0x27bc5ed  google::LogMessage::Fail()
          @          0x27bef16  google::LogMessage::SendToLog()
          @          0x27bc10d  google::LogMessage::Flush()
          @          0x27bf9be  google::LogMessageFatal::~LogMessageFatal()
          @          0x15c88dc  impala::HdfsParquetScanner::LevelDecoder::CacheNextBatch()
          @          0x15f71cf  impala::HdfsParquetScanner::ScalarColumnReader<>::ReadValueBatch<>()
          @          0x15edc92  impala::HdfsParquetScanner::ScalarColumnReader<>::ReadValueBatch()
          @          0x15cc1c5  impala::HdfsParquetScanner::AssembleRows()
          @          0x15ca9ea  impala::HdfsParquetScanner::ProcessSplit()
          @          0x15814a4  impala::HdfsScanNode::ProcessSplit()
          @          0x1580579  impala::HdfsScanNode::ScannerThread()
          @          0x159c6e3  boost::_mfi::mf0<>::operator()()
          @          0x159b866  boost::_bi::list1<>::operator()<>()
          @          0x159a315  boost::_bi::bind_t<>::operator()()
          @          0x159813c  boost::detail::function::void_function_obj_invoker0<>::invoke()
          @          0x124f77c  boost::function0<>::operator()()
          @          0x14ecc3d  impala::Thread::SuperviseThread()
          @          0x14f37a0  boost::_bi::list4<>::operator()<>()
          @          0x14f36e3  boost::_bi::bind_t<>::operator()()
          @          0x14f36a6  boost::detail::thread_data<>::run()
          @          0x192d19a  thread_proxy
          @       0x39c68079d1  (unknown)
          @       0x39c64e88fd  (unknown)
      Picked up JAVA_TOOL_OPTIONS: 
      

        Attachments

          Activity

            People

            • Assignee:
              alex.behm Alexander Behm
              Reporter:
              tarmstrong Tim Armstrong
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: