[IMPALA-54] Failed DCHECK during failure injection testing: Check Failed: counter->type() == TCounterType::CPU_TICKS || counter->type() == TCounterType::TIME_MS

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Works for Me
• Affects Version/s: Impala 0.5
• Fix Version/s: Impala 0.7
• Assignee: Alan Choi
• Reporter: Lenni Kuff
• Created: 07/Feb/13 22:08
• Updated: 18/Apr/13 00:14
• Resolved: 18/Apr/13 00:13

Description

Injecting failure during OPEN of HDFS_SCAN_NODE hits DCHECK for the query:

select a.int_col, count(b.int_col) isum from alltypes a 
  join (select * from alltypes where year=2009 and month=1 order by int_col limit 25
        union all
        select * from alltypes where year=2009 and month=2 limit 10) b 
  on (a.int_col = b.int_col)
group by a.int_col
order by isum
limit 20

Stack Trace

F0207 14:04:24.214879 24288 runtime-profile.h:324] Check failed: counter->type() == TCounterType::CPU_TICKS || counter->type() == TCounterType::TIME_MS 
*** Check failure stack trace: ***
E0207 14:04:24.220434 23674 data-stream-mgr.cc:189] unknown row batch destination: fragment_id=ba5a9acb71742dc:af77ba99e40e1107 node_id=9
    @          0x15d0d2d  google::LogMessage::Fail()
    @          0x15d34bf  google::LogMessage::SendToLog()
    @          0x15d092b  google::LogMessage::Flush()
    @          0x15d3d4d  google::LogMessageFatal::~LogMessageFatal()
    @           0xa6b40f  impala::ScopedTimer<>::ScopedTimer()
    @           0xd7c6cf  impala::DataStreamSender::Channel::TransmitData()
    @           0xd80266  boost::_mfi::mf0<>::operator()()
    @           0xd801d6  boost::_bi::list1<>::operator()<>()
    @           0xd80185  boost::_bi::bind_t<>::operator()()
    @           0xd8014a  boost::detail::thread_data<>::run()
    @     0x7ff9607eace9  (unknown)
    @     0x7ff9605c8e9a  start_thread

Test that hit bug:

FAIL failure/test_failpoints.py::TestFailpoints::()::test_failpoint[action: FAIL | node_type: HDFS_SCAN_NODE | node_location: OPEN | exec_option: {'disable_codegen': False, 'batch_size': 16, 'num_nodes': 1} | table_format: text/none]