Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-2772

MultiThreadedTabletTest/1.DeleteAndReinsert failed with crashing on MVCC assertion

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.10.0
    • Fix Version/s: n/a
    • Component/s: test, tserver
    • Labels:
      None

      Description

      My 'manual pre-commit verification' (run via dist-test) failed in DEBUG configuration with the following log:

      I0410 21:13:19.630455   232 mvcc.cc:203] Tried to move safe_time back from 11154 to 11141. Current Snapshot: MvccSnapshot[committed={T|T < 11099 or (T in {11105,11101,11102,11100,11109,11110,11111,11112,11113,11107,11114,11106,11116,11108,11117,11120,11121,11122,11123,11115,11124,11126,11127,11119,11118,11128,11130,11125,11129,11103,11104,11132,11134,11136,11135,11137,11138,11143,11145,11133,11142,11146,11139,11151,11148,11150,11153,11154,11152,11140})}]
      F0410 21:13:19.632110   231 delta_tracker.cc:254] Check failed: first_copy->delta_stats().min_timestamp() >= second_copy->delta_stats().min_timestamp() (10711 vs. 10715) Found out-of-order deltas: [{17740622907152428418 (ts range=[10711, 10830], delete_count=[0], reinsert_count=[0], update_counts_by_col_id=[12:4])}, {17740622907152428397 (ts range=[10715, 10743], delete_count=[0], reinsert_count=[0], update_counts_by_col_id=[12:6])}]: type = 1
      *** Check failure stack trace: ***
      *** Aborted at 1554930799 (unix time) try "date -d @1554930799" if you are using GNU date ***
      PC: @     0x7f50409fbc37 gsignal
      *** SIGABRT (@0x3e8000000da) received by PID 218 (TID 0x7f503af5d700) from PID 218; stack trace: ***
          @     0x7f5049332330 (unknown) at ??:0
          @     0x7f50409fbc37 gsignal at ??:0
          @     0x7f50409ff028 abort at ??:0
          @     0x7f50428bfa09 google::logging_fail() at ??:0
          @     0x7f50428c12fd google::LogMessage::Fail() at ??:0
          @     0x7f50428c31bd google::LogMessage::SendToLog() at ??:0
          @     0x7f50428c0e39 google::LogMessage::Flush() at ??:0
          @     0x7f50428c3c5f google::LogMessageFatal::~LogMessageFatal() at ??:0
          @     0x7f504c382065 kudu::tablet::DeltaTracker::ValidateDeltaOrder() at ??:0
          @     0x7f504c382a30 kudu::tablet::DeltaTracker::AtomicUpdateStores() at ??:0
          @     0x7f504c35a323 kudu::tablet::MajorDeltaCompaction::UpdateDeltaTracker() at ??:0
          @     0x7f504c2b0ddb kudu::tablet::DiskRowSet::MajorCompactDeltaStoresWithColumnIds() at ??:0
          @     0x7f504c2b040b kudu::tablet::DiskRowSet::MajorCompactDeltaStores() at ??:0
          @     0x7f504c1d55bb kudu::tablet::Tablet::CompactWorstDeltas() at ??:0
          @           0x47bb18 kudu::tablet::MultiThreadedTabletTest<>::CompactDeltas() at /data/8/aserbin/Projects/kudu/src/kudu/tablet/mt-tablet-test.cc:333
          @           0x47761c kudu::tablet::MultiThreadedTabletTest<>::MajorCompactDeltasThread() at /data/8/aserbin/Projects/kudu/src/kudu/tablet/mt-tablet-test.cc:327
          @           0x47abef boost::_mfi::mf1<>::operator()() at /data/8/aserbin/Projects/kudu/thirdparty/installed/uninstrumented/include/boost/bind/mem_fn_template.hpp:165
          @           0x47ab4e boost::_bi::list2<>::operator()<>() at /data/8/aserbin/Projects/kudu/thirdparty/installed/uninstrumented/include/boost/bind/bind.hpp:320
          @           0x47aada boost::_bi::bind_t<>::operator()() at /data/8/aserbin/Projects/kudu/thirdparty/installed/uninstrumented/include/boost/bind/bind.hpp:1222
          @           0x47a860 boost::detail::function::void_function_obj_invoker0<>::invoke() at /data/8/aserbin/Projects/kudu/thirdparty/installed/uninstrumented/include/boost/function/function_template.hpp:160
          @     0x7f5045a44568 boost::function0<>::operator()() at ??:0
          @     0x7f50449f077d kudu::Thread::SuperviseThread() at ??:0
          @     0x7f504932a184 start_thread at ??:0
          @     0x7f5040ac2ffd clone at ??:0
      

      Full test log is attached.

        Attachments

        1. mt-tablet-test.3.txt.xz
          18 kB
          Alexey Serbin

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                aserbin Alexey Serbin
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: