[ARROW-17103] [C++][CI] arrow-dataset-scanner-test has been failing on some nightly cpp builds

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Duplicate
• Component/s: C++
• Labels: Nightly
• External issue URL: https://github.com/apache/arrow/issues/32408
• Assignee: Unassigned
• Reporter: Raúl Cumplido
• Created: 18/Jul/22 10:02
• Updated: 11/Jan/23 11:48
• Resolved: 18/Jul/22 13:10

Description

There has been a couple of nightly build failures:

test-ubuntu-20.04-cpp
test-ubuntu-20.04-cpp-14
test-ubuntu-20.04-cpp-bundled

Where arrow-dataset-scanner-test is failing with the following error:

[ RUN      ] TestScannerThreading/TestScanner.ScanBatchesFailure/2Threaded1d1b1024r
/arrow/cpp/src/arrow/util/future.cc:331:  Check failed: !IsFutureFinished(state_) Future already marked finished
/usr/local/lib/libarrow.so.900(arrow::util::CerrLog::PrintBackTrace()+0x39)[0x7f1608d7125f]
/usr/local/lib/libarrow.so.900(arrow::util::CerrLog::~CerrLog()+0x5f)[0x7f1608d711cf]
/usr/local/lib/libarrow.so.900(arrow::util::CerrLog::~CerrLog()+0x1c)[0x7f1608d711f4]
/usr/local/lib/libarrow.so.900(arrow::util::ArrowLog::~ArrowLog()+0x4b)[0x7f1608d71007]
/usr/local/lib/libarrow.so.900(arrow::ConcreteFutureImpl::DoMarkFinishedOrFailed(arrow::FutureState)+0x182)[0x7f1608d3bc48]
/usr/local/lib/libarrow.so.900(arrow::ConcreteFutureImpl::DoMarkFailed()+0x21)[0x7f1608d3af11]
/usr/local/lib/libarrow.so.900(arrow::FutureImpl::MarkFailed()+0x24)[0x7f1608d36618]
/build/cpp/debug/arrow-dataset-scanner-test(arrow::Future<arrow::internal::Empty>::DoMarkFinished(arrow::Result<arrow::internal::Empty>)+0xac)[0x558c15d54542]
/build/cpp/debug/arrow-dataset-scanner-test(void arrow::Future<arrow::internal::Empty>::MarkFinished<arrow::internal::Empty, void>(arrow::Status)+0x7b)[0x558c15d42aab]
/usr/local/lib/libarrow.so.900(+0x215c44d)[0x7f160915c44d]
/usr/local/lib/libarrow.so.900(+0x2161931)[0x7f1609161931]
/usr/local/lib/libarrow.so.900(+0x216149d)[0x7f160916149d]
/usr/local/lib/libarrow.so.900(+0x2161219)[0x7f1609161219]
/usr/local/lib/libarrow.so.900(+0x2161111)[0x7f1609161111]
/usr/local/lib/libarrow.so.900(arrow::internal::FnOnce<void (arrow::FutureImpl const&)>::operator()(arrow::FutureImpl const&) &&+0x72)[0x7f1608d3d3be]
/usr/local/lib/libarrow.so.900(arrow::ConcreteFutureImpl::AddCallback(arrow::internal::FnOnce<void (arrow::FutureImpl const&)>, arrow::CallbackOptions)::SpanWrapper::operator()(arrow::FutureImpl const&)+0x7d)[0x7f1608d3b095]
/usr/local/lib/libarrow.so.900(arrow::internal::FnOnce<void (arrow::FutureImpl const&)>::FnImpl<arrow::ConcreteFutureImpl::AddCallback(arrow::internal::FnOnce<void (arrow::FutureImpl const&)>, arrow::CallbackOptions)::SpanWrapper>::invoke(arrow::FutureImpl const&)+0x3f)[0x7f1608d4911b]
/usr/local/lib/libarrow.so.900(arrow::internal::FnOnce<void (arrow::FutureImpl const&)>::operator()(arrow::FutureImpl const&) &&+0x72)[0x7f1608d3d3be]
/usr/local/lib/libarrow.so.900(arrow::ConcreteFutureImpl::RunOrScheduleCallback(std::shared_ptr<arrow::FutureImpl> const&, arrow::FutureImpl::CallbackRecord&&, bool)::CallbackTask::operator()()+0x3b)[0x7f1608d3b74b]
/usr/local/lib/libarrow.so.900(arrow::internal::FnOnce<void ()>::FnImpl<arrow::ConcreteFutureImpl::RunOrScheduleCallback(std::shared_ptr<arrow::FutureImpl> const&, arrow::FutureImpl::CallbackRecord&&, bool)::CallbackTask>::invoke()+0x28)[0x7f1608d490d8]
/usr/local/lib/libarrow.so.900(arrow::internal::FnOnce<void ()>::operator()() &&+0x59)[0x7f1608d9506f]
/usr/local/lib/libarrow.so.900(+0x1d91b91)[0x7f1608d91b91]
/usr/local/lib/libarrow.so.900(+0x1d9490c)[0x7f1608d9490c]
/usr/local/lib/libarrow.so.900(arrow::internal::FnOnce<void ()>::operator()() &&+0x59)[0x7f1608d9506f]
/usr/local/lib/libarrow.so.900(+0x1d90ae5)[0x7f1608d90ae5]
/usr/local/lib/libarrow.so.900(+0x1d91958)[0x7f1608d91958]
/usr/local/lib/libarrow.so.900(+0x1d94a63)[0x7f1608d94a63]
/usr/local/lib/libarrow.so.900(+0x1d94a04)[0x7f1608d94a04]
/usr/local/lib/libarrow.so.900(+0x1d949a2)[0x7f1608d949a2]
/usr/local/lib/libarrow.so.900(+0x1d94963)[0x7f1608d94963]
/usr/local/lib/libarrow.so.900(+0x1d948e0)[0x7f1608d948e0]
/lib/x86_64-linux-gnu/libstdc++.so.6(+0xd6de4)[0x7f1606eedde4]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x8609)[0x7f160629e609]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x43)[0x7f1606d29133]
/build/cpp/src/arrow/dataset 

Issue Links

• duplicates: ARROW-17087 [C++] Race condition in scanner test