[IMPALA-3317] Stress test failure: sorter.cc:745] Check failed: i == 0 (1 vs. 0)

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 2.5.0
• Fix Version/s: Impala 2.6.0, impala 2.5.1
• Component/s: Backend
• Labels: correctness crash stress
• Target Version: Impala 2.6.0, impala 2.5.1
• Assignee: Tim Armstrong
• Reporter: Skye Wanderman-Milne
• Created: 08/Apr/16 00:24
• Updated: 24/Jun/17 03:39
• Resolved: 20/Apr/16 23:50

Description

Looks like amid all the IMPALA-3299 failures the stress test actually crashed.
http://sandbox.jenkins.cloudera.com/view/Impala/view/Stress/job/Impala-Stress-Test-EC2-CDH5-trunk/632/console

13:42:50 F0405 13:41:14.473417 20384 sorter.cc:745] Check failed: i == 0 (1 vs. 0) 
13:42:50 [...skipped...]
13:42:50 #6  0x00000000022cd0be in google::LogMessageFatal::~LogMessageFatal() ()
13:42:50 #7  0x00000000018894da in impala::Sorter::Run::GetNext<true> (this=0x143dc3400, output_batch=0x1bb5d180, eos=0x7f92e0f4845f) at /usr/src/debug/impala-2.6.0-cdh5.8.0-SNAPSHOT/be/src/runtime/sorter.cc:745
13:42:50 #8  0x0000000001882e61 in impala::Sorter::Run::GetNextBatch (this=0x143dc3400, output_batch=0xcda50620) at /usr/src/debug/impala-2.6.0-cdh5.8.0-SNAPSHOT/be/src/runtime/sorter.cc:640
13:42:50 #9  0x000000000188f690 in boost::_mfi::mf1<impala::Status, impala::Sorter::Run, impala::RowBatch**>::operator() (this=0xcda50608, p=0x143dc3400, a1=0xcda50620) at /usr/src/debug/impala-2.6.0-cdh5.8.0-SNAPSHOT/toolchain/boost-1.57.0/include/boost/bind/mem_fn_template.hpp:165
13:42:50 #10 0x000000000188f3f8 in boost::_bi::list2<boost::_bi::value<impala::Sorter::Run*>, boost::arg<1> >::operator()<impala::Status, boost::_mfi::mf1<impala::Status, impala::Sorter::Run, impala::RowBatch**>, boost::_bi::list1<impala::RowBatch**&> > (this=0xcda50618, f=..., a=...) at /usr/src/debug/impala-2.6.0-cdh5.8.0-SNAPSHOT/toolchain/boost-1.57.0/include/boost/bind/bind.hpp:303
13:42:50 #11 0x000000000188f1e5 in boost::_bi::bind_t<impala::Status, boost::_mfi::mf1<impala::Status, impala::Sorter::Run, impala::RowBatch**>, boost::_bi::list2<boost::_bi::value<impala::Sorter::Run*>, boost::arg<1> > >::operator()<impala::RowBatch**> (this=0xcda50608, a1=@0x7f92e0f485f8) at /usr/src/debug/impala-2.6.0-cdh5.8.0-SNAPSHOT/toolchain/boost-1.57.0/include/boost/bind/bind_template.hpp:32
13:42:50 #12 0x000000000188efd2 in boost::detail::function::function_obj_invoker1<boost::_bi::bind_t<impala::Status, boost::_mfi::mf1<impala::Status, impala::Sorter::Run, impala::RowBatch**>, boost::_bi::list2<boost::_bi::value<impala::Sorter::Run*>, boost::arg<1> > >, impala::Status, impala::RowBatch**>::invoke (function_obj_ptr=..., a0=0xcda50620) at /usr/src/debug/impala-2.6.0-cdh5.8.0-SNAPSHOT/toolchain/boost-1.57.0/include/boost/function/function_template.hpp:132
13:42:50 #13 0x000000000130e53a in boost::function1<impala::Status, impala::RowBatch**>::operator() (this=0xcda50600, a0=0xcda50620) at /usr/src/debug/impala-2.6.0-cdh5.8.0-SNAPSHOT/toolchain/boost-1.57.0/include/boost/function/function_template.hpp:767
13:42:50 #14 0x000000000130dfa1 in impala::SortedRunMerger::BatchedRowSupplier::Next (this=0xcda50600, transfer_batch=0x0, done=0x7f92e0f487cf) at /usr/src/debug/impala-2.6.0-cdh5.8.0-SNAPSHOT/be/src/runtime/sorted-run-merger.cc:68
13:42:50 #15 0x000000000130d1b9 in impala::SortedRunMerger::GetNext (this=0x17c5de1b0, output_batch=0xcc007320, eos=0x21127099) at /usr/src/debug/impala-2.6.0-cdh5.8.0-SNAPSHOT/be/src/runtime/sorted-run-merger.cc:172
13:42:50 #16 0x0000000001886005 in impala::Sorter::GetNext (this=0x1c02b740, output_batch=0xcc007320, eos=0x21127099) at /usr/src/debug/impala-2.6.0-cdh5.8.0-SNAPSHOT/be/src/runtime/sorter.cc:1086
13:42:50 #17 0x000000000169051e in impala::SortNode::GetNext (this=0x208f1c00, state=0x7052400, row_batch=0xcc007320, eos=0x21127099) at /usr/src/debug/impala-2.6.0-cdh5.8.0-SNAPSHOT/be/src/exec/sort-node.cc:98
13:42:50 #18 0x000000000187d205 in impala::PlanFragmentExecutor::GetNextInternal (this=0x21126f70, batch=0x7f92e0f48d18) at /usr/src/debug/impala-2.6.0-cdh5.8.0-SNAPSHOT/be/src/runtime/plan-fragment-executor.cc:492

Issue Links

• is related to: IMPALA-5554 crash in impala::Sorter::Run::ConvertOffsetsToPtrs