[IMPALA-5857] Crash in impala::DiskIoMgr::ScanRange::Close-> tc_free while running concurrent TPC-DS

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 2.10.0
• Fix Version/s: Impala 2.10.0
• Component/s: Backend
• Target Version: Impala 2.10.0
• Epic Color: ghx-label-2
• Assignee: Tim Armstrong
• Reporter: Mostafa Mokhtar
• Created: 29/Aug/17 20:48
• Updated: 31/Aug/17 21:50
• Resolved: 30/Aug/17 04:10

Description

Crash in

#0  0x00000032fd832625 in raise () from /lib64/libc.so.6
#1  0x00000032fd833e05 in abort () from /lib64/libc.so.6
#2  0x0000000001c0571d in tcmalloc::Log(tcmalloc::LogMode, char const*, int, tcmalloc::LogItem, tcmalloc::LogItem, tcmalloc::LogItem, tcmalloc::LogItem) ()
#3  0x0000000001bff44d in ?? ()
#4  0x0000000001c1e688 in tc_free ()
#5  0x0000000000a2b355 in impala::DiskIoMgr::ScanRange::Close() ()
#6  0x0000000000ce5833 in impala::ScannerContext::Stream::ReleaseCompletedResources(impala::RowBatch*, bool) ()
#7  0x0000000000ce5b32 in impala::ScannerContext::ReleaseCompletedResources(impala::RowBatch*, bool) ()
#8  0x0000000000c77125 in impala::HdfsParquetScanner::Open(impala::ScannerContext*) ()
#9  0x0000000000c3df80 in impala::HdfsScanNodeBase::CreateAndOpenScanner(impala::HdfsPartitionDescriptor*, impala::ScannerContext*, boost::scoped_ptr<impala::HdfsScanner>*) ()
#10 0x0000000000c39456 in impala::HdfsScanNode::ProcessSplit(std::vector<impala::FilterContext, std::allocator<impala::FilterContext> > const&, impala::DiskIoMgr::ScanRange*) ()
#11 0x0000000000c3b4f1 in impala::HdfsScanNode::ScannerThread() ()
#12 0x0000000000bd34c2 in impala::Thread::SuperviseThread(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, boost::function<void ()()>, impala::Promise<long>*) ()
#13 0x0000000000bd3c24 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, boost::function<void ()()>, impala::Promise<long>*), boost::_bi::list4<boost::_bi::value<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, boost::_bi::value<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, boost::_bi::value<boost::function<void ()()> >, boost::_bi::value<impala::Promise<long>*> > > >::run() ()
#14 0x0000000000e5dc7a in ?? ()
#15 0x00000032fdc07aa1 in start_thread () from /lib64/libpthread.so.0
#16 0x00000032fd8e893d in clone () from /lib64/libc.so.6

Issue Links

• is broken by: IMPALA-4623 Parquet Scanner - reduce NN RPC