Major Description
My 'manual pre-commit verification' (run via dist-test) failed in DEBUG configuration with the following log:
I0410 21:13:19.630455 232 mvcc.cc:203] Tried to move safe_time back from 11154 to 11141. Current Snapshot: MvccSnapshot[committed={T|T < 11099 or (T in {11105,11101,11102,11100,11109,11110,11111,11112,11113,11107,11114,11106,11116,11108,11117,11120,11121,11122,11123,11115,11124,11126,11127,11119,11118,11128,11130,11125,11129,11103,11104,11132,11134,11136,11135,11137,11138,11143,11145,11133,11142,11146,11139,11151,11148,11150,11153,11154,11152,11140})}]
F0410 21:13:19.632110 231 delta_tracker.cc:254] Check failed: first_copy->delta_stats().min_timestamp() >= second_copy->delta_stats().min_timestamp() (10711 vs. 10715) Found out-of-order deltas: [{17740622907152428418 (ts range=[10711, 10830], delete_count=[0], reinsert_count=[0], update_counts_by_col_id=[12:4])}, {17740622907152428397 (ts range=[10715, 10743], delete_count=[0], reinsert_count=[0], update_counts_by_col_id=[12:6])}]: type = 1
*** Check failure stack trace: ***
*** Aborted at 1554930799 (unix time) try "date -d @1554930799" if you are using GNU date ***
PC: @ 0x7f50409fbc37 gsignal
*** SIGABRT (@0x3e8000000da) received by PID 218 (TID 0x7f503af5d700) from PID 218; stack trace: ***
@ 0x7f5049332330 (unknown) at ??:0
@ 0x7f50409fbc37 gsignal at ??:0
@ 0x7f50409ff028 abort at ??:0
@ 0x7f50428bfa09 google::logging_fail() at ??:0
@ 0x7f50428c12fd google::LogMessage::Fail() at ??:0
@ 0x7f50428c31bd google::LogMessage::SendToLog() at ??:0
@ 0x7f50428c0e39 google::LogMessage::Flush() at ??:0
@ 0x7f50428c3c5f google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f504c382065 kudu::tablet::DeltaTracker::ValidateDeltaOrder() at ??:0
@ 0x7f504c382a30 kudu::tablet::DeltaTracker::AtomicUpdateStores() at ??:0
@ 0x7f504c35a323 kudu::tablet::MajorDeltaCompaction::UpdateDeltaTracker() at ??:0
@ 0x7f504c2b0ddb kudu::tablet::DiskRowSet::MajorCompactDeltaStoresWithColumnIds() at ??:0
@ 0x7f504c2b040b kudu::tablet::DiskRowSet::MajorCompactDeltaStores() at ??:0
@ 0x7f504c1d55bb kudu::tablet::Tablet::CompactWorstDeltas() at ??:0
@ 0x47bb18 kudu::tablet::MultiThreadedTabletTest<>::CompactDeltas() at /data/8/aserbin/Projects/kudu/src/kudu/tablet/mt-tablet-test.cc:333
@ 0x47761c kudu::tablet::MultiThreadedTabletTest<>::MajorCompactDeltasThread() at /data/8/aserbin/Projects/kudu/src/kudu/tablet/mt-tablet-test.cc:327
@ 0x47abef boost::_mfi::mf1<>::operator()() at /data/8/aserbin/Projects/kudu/thirdparty/installed/uninstrumented/include/boost/bind/mem_fn_template.hpp:165
@ 0x47ab4e boost::_bi::list2<>::operator()<>() at /data/8/aserbin/Projects/kudu/thirdparty/installed/uninstrumented/include/boost/bind/bind.hpp:320
@ 0x47aada boost::_bi::bind_t<>::operator()() at /data/8/aserbin/Projects/kudu/thirdparty/installed/uninstrumented/include/boost/bind/bind.hpp:1222
@ 0x47a860 boost::detail::function::void_function_obj_invoker0<>::invoke() at /data/8/aserbin/Projects/kudu/thirdparty/installed/uninstrumented/include/boost/function/function_template.hpp:160
@ 0x7f5045a44568 boost::function0<>::operator()() at ??:0
@ 0x7f50449f077d kudu::Thread::SuperviseThread() at ??:0
@ 0x7f504932a184 start_thread at ??:0
@ 0x7f5040ac2ffd clone at ??:0
Full test log is attached.
