[==========] Running 20 tests from 10 test cases. [----------] Global test environment set-up. [----------] 2 tests from MultiThreadedTabletTest/0, where TypeParam = kudu::tablet::StringKeyTestSetup [ RUN ] MultiThreadedTabletTest/0.DoTestAllAtOnce WARNING: Logging before InitGoogleLogging() is written to STDERR I0528 18:07:06.781378 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:06.782270 31579 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 0.000} I0528 18:07:07.032501 31579 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 0.250, "inserted": 0.000, "num_rowsets": 0.000, "memrowset_kb": 1536.000} I0528 18:07:07.282742 31579 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 0.500, "inserted": 0.000, "num_rowsets": 0.000, "memrowset_kb": 1536.000} I0528 18:07:07.533031 31579 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 0.751, "inserted": 0.000, "num_rowsets": 0.000, "memrowset_kb": 1536.000} I0528 18:07:07.600533 31601 mt-tablet-test.cc:88] Update thread using schema: Schema [key[string NOT NULL], val[uint32 NOT NULL], update_count[uint32 NOT NULL]] I0528 18:07:07.658509 31598 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:07.658571 31598 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:07.658823 31598 compaction.cc:551] memrowset(0 bytes) I0528 18:07:07.659195 31598 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:07.659546 31598 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:07.723243 31598 diskrowset.cc:94] Opened CFile writer for column key[string NOT NULL] I0528 18:07:07.723636 31598 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:07.723932 31598 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:07.748893 31598 cfile_set.cc:71] Successfully opened cfile for column key[string NOT NULL] in RowSet(0) I0528 18:07:07.749084 31598 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(0) I0528 18:07:07.749217 31598 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(0) I0528 18:07:07.749619 31598 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:07.751786 31598 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:07.774278 31598 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:07.774327 31598 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 308}] I0528 18:07:07.783262 31579 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 1.001, "inserted": 0.000, "scanned": 422.000, "updated": 0.000, "num_rowsets": 0.000, "memrowset_kb": 1536.000} I0528 18:07:07.800338 31598 delta_tracker.cc:528] Flushing 10 deltas... I0528 18:07:07.801879 31598 delta_tracker.cc:475] Flushed delta block: 983ad1f1dbf14318815e68d417374bb3 I0528 18:07:07.802228 31598 delta_tracker.cc:487] Reopened delta block for read: 983ad1f1dbf14318815e68d417374bb3 I0528 18:07:07.832877 31598 tablet.cc:1207] Flush successful on 179 rows (68444 bytes) I0528 18:07:07.836895 31598 delta_tracker.cc:528] Flushing 5 deltas... I0528 18:07:07.840915 31598 delta_tracker.cc:475] Flushed delta block: ba6b5ae70f7946a483f32930bb634999 I0528 18:07:07.842664 31598 delta_tracker.cc:487] Reopened delta block for read: ba6b5ae70f7946a483f32930bb634999 I0528 18:07:07.898146 31598 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:07.898211 31598 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:07.898465 31598 compaction.cc:551] memrowset(0 bytes) I0528 18:07:07.898509 31598 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:07.898546 31598 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:07.899780 31598 diskrowset.cc:94] Opened CFile writer for column key[string NOT NULL] I0528 18:07:07.900956 31598 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:07.901576 31598 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:08.033741 31579 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 1.252, "inserted": 1632.000, "scanned": 8085.000, "updated": 50.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:08.060705 31598 cfile_set.cc:71] Successfully opened cfile for column key[string NOT NULL] in RowSet(1) I0528 18:07:08.060840 31598 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:08.060940 31598 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:08.061318 31598 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:08.064968 31598 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:08.065901 31598 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:08.066181 31598 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2310}] I0528 18:07:08.161334 31598 delta_tracker.cc:528] Flushing 41 deltas... I0528 18:07:08.162547 31598 delta_tracker.cc:475] Flushed delta block: 870a4c7f81d04afdb15263134d6d3e80 I0528 18:07:08.162835 31598 delta_tracker.cc:487] Reopened delta block for read: 870a4c7f81d04afdb15263134d6d3e80 I0528 18:07:08.176020 31599 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:08.176059 31599 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:08.176084 31599 compaction.cc:551] RowSet(0)(3007 bytes) I0528 18:07:08.176122 31599 compaction.cc:551] RowSet(1)(16713 bytes) I0528 18:07:08.176152 31599 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:08.177671 31599 diskrowset.cc:94] Opened CFile writer for column key[string NOT NULL] I0528 18:07:08.177918 31599 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:08.178171 31599 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:08.183748 31598 tablet.cc:1207] Flush successful on 1059 rows (82149 bytes) I0528 18:07:08.191612 31598 delta_tracker.cc:528] Flushing 3 deltas... I0528 18:07:08.193856 31598 delta_tracker.cc:475] Flushed delta block: f2f8ac08dfdc49259af66aede92a4403 I0528 18:07:08.195067 31598 delta_tracker.cc:487] Reopened delta block for read: f2f8ac08dfdc49259af66aede92a4403 I0528 18:07:08.283124 31598 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:08.283162 31598 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:08.283184 31598 compaction.cc:551] memrowset(0 bytes) I0528 18:07:08.283205 31598 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:08.283224 31598 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:08.283964 31579 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 1.502, "inserted": 2958.000, "scanned": 16674.000, "updated": 80.000, "num_rowsets": 3.000, "memrowset_kb": 1536.000} I0528 18:07:08.284167 31598 diskrowset.cc:94] Opened CFile writer for column key[string NOT NULL] I0528 18:07:08.284474 31598 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:08.284791 31598 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:08.314200 31599 cfile_set.cc:71] Successfully opened cfile for column key[string NOT NULL] in RowSet(2) I0528 18:07:08.314345 31599 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(2) I0528 18:07:08.314517 31599 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(2) I0528 18:07:08.315009 31599 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:08.318979 31599 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:08.322397 31599 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:08.323510 31599 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 3736}] I0528 18:07:08.349158 31599 delta_tracker.cc:528] Flushing 14 deltas... I0528 18:07:08.354452 31599 delta_tracker.cc:475] Flushed delta block: a9cc06aabb1842b7b70bd3bad86a468c I0528 18:07:08.354917 31599 delta_tracker.cc:487] Reopened delta block for read: a9cc06aabb1842b7b70bd3bad86a468c I0528 18:07:08.383646 31599 tablet.cc:1207] Compaction successful on 1238 rows (84879 bytes) I0528 18:07:08.534159 31579 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 1.752, "inserted": 4794.000, "scanned": 28041.000, "updated": 110.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} W0528 18:07:08.599897 31573 thread.cc:359] Waited for 1000ms trying to join with test0 I0528 18:07:08.617810 31598 cfile_set.cc:71] Successfully opened cfile for column key[string NOT NULL] in RowSet(3) I0528 18:07:08.618019 31598 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(3) I0528 18:07:08.618197 31598 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(3) I0528 18:07:08.618715 31598 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:08.622700 31598 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:08.625625 31598 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:08.625689 31598 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 6152}] I0528 18:07:08.784361 31579 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 2.002, "inserted": 6876.000, "scanned": 38145.000, "updated": 170.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:08.844534 31598 tablet.cc:1207] Flush successful on 2294 rows (101378 bytes) I0528 18:07:08.852018 31598 delta_tracker.cc:528] Flushing 14 deltas... I0528 18:07:08.853045 31598 delta_tracker.cc:475] Flushed delta block: 71e56626c988475382f8e96ec2f13a00 I0528 18:07:08.853410 31598 delta_tracker.cc:487] Reopened delta block for read: 71e56626c988475382f8e96ec2f13a00 I0528 18:07:08.889719 31599 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:08.889762 31599 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:08.889782 31599 compaction.cc:551] RowSet(2)(19443 bytes) I0528 18:07:08.889813 31599 compaction.cc:551] RowSet(3)(35946 bytes) I0528 18:07:08.889840 31599 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:08.890787 31599 diskrowset.cc:94] Opened CFile writer for column key[string NOT NULL] I0528 18:07:08.891211 31599 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:08.891435 31599 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:09.034575 31579 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 2.252, "inserted": 8000.000, "scanned": 54013.000, "updated": 210.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:09.071228 31599 cfile_set.cc:71] Successfully opened cfile for column key[string NOT NULL] in RowSet(4) I0528 18:07:09.071353 31599 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(4) I0528 18:07:09.071483 31599 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(4) I0528 18:07:09.071794 31599 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:09.073767 31599 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:09.073943 31599 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:09.073976 31599 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 8217}] I0528 18:07:09.112156 31599 delta_tracker.cc:528] Flushing 10 deltas... I0528 18:07:09.112800 31599 delta_tracker.cc:475] Flushed delta block: c014f2f13c5d44869ddd46b44eeb71ac I0528 18:07:09.113030 31599 delta_tracker.cc:487] Reopened delta block for read: c014f2f13c5d44869ddd46b44eeb71ac I0528 18:07:09.131844 31599 tablet.cc:1207] Compaction successful on 3532 rows (120623 bytes) I0528 18:07:09.230649 31573 mt-tablet-test.cc:358] Sum = 31996000 I0528 18:07:09.230705 31573 mt-tablet-test.cc:356] Times for Summing int32 column: real 0.074s user 0.065s sys 0.005s I0528 18:07:09.284785 31579 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 2.503, "inserted": 8000.000, "scanned": 54013.000, "updated": 210.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:09.445242 31573 tablet-test-base.h:736] Successfully verified 8000rows [ OK ] MultiThreadedTabletTest/0.DoTestAllAtOnce (2715 ms) [ RUN ] MultiThreadedTabletTest/0.DeleteAndReinsert I0528 18:07:09.492532 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:09.493098 31602 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 0.000} I0528 18:07:09.504896 31603 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:09.504952 31603 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:09.504992 31603 compaction.cc:551] memrowset(0 bytes) I0528 18:07:09.505029 31603 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:09.505100 31603 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:09.515732 31603 diskrowset.cc:94] Opened CFile writer for column key[string NOT NULL] I0528 18:07:09.517652 31603 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:09.519170 31603 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:09.524440 31603 tablet.cc:1086] Flush resulted in no output rows (all input rows were GCed!) Removing all input rowsets. I0528 18:07:09.557816 31603 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:09.557865 31603 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:09.557903 31603 compaction.cc:551] memrowset(0 bytes) I0528 18:07:09.557937 31603 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:09.557973 31603 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:09.558931 31603 diskrowset.cc:94] Opened CFile writer for column key[string NOT NULL] I0528 18:07:09.559341 31603 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:09.559705 31603 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] W0528 18:07:09.563499 31603 compaction.cc:654] Found REINSERT REDO truncating row history for Row: (string key=hello 0, uint32 val=0, uint32 update_count=1) Redo Mutations: [@14(SET update_count=0), @20(DELETE), @25(REINSERT (string key=hello 0, uint32 val=0, uint32 update_count=1)), @36(DELETE), @43(REINSERT (string key=hello 0, uint32 val=0, uint32 update_count=2)), @48(SET update_count=1), @50(DELETE), @57(REINSERT (string key=hello 0, uint32 val=0, uint32 update_count=3)), @59(SET update_count=3), @62(DELETE), @86(REINSERT (string key=hello 0, uint32 val=0, uint32 update_count=4)), @98(SET update_count=8), @127(DELETE), @148(REINSERT (string key=hello 0, uint32 val=0, uint32 update_count=5)), @152(SET update_count=11), @169(DELETE), @230(REINSERT (string key=hello 0, uint32 val=0, uint32 update_count=6)), @246(SET update_count=13), @269(DELETE), @289(REINSERT (string key=hello 0, uint32 val=0, uint32 update_count=7)), @293(SET update_count=15), @304(DELETE), @311(REINSERT (string key=hello 0, uint32 val=0, uint32 update_count=8)), @313(SET update_count=17), @318(DELETE), @324(REINSERT (string key=hello 0, uint32 val=0, uint32 update_count=9)), @336(SET update_count=18), @353(DELETE)] Undo Mutations: [@4(DELETE)] Note: this warning will appear only for the first truncated row W0528 18:07:09.614389 31603 compaction.cc:764] Total 84 rows lost some history due to REINSERT after DELETE I0528 18:07:09.624338 31603 cfile_set.cc:71] Successfully opened cfile for column key[string NOT NULL] in RowSet(1) I0528 18:07:09.624528 31603 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:09.624704 31603 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:09.625140 31603 delta_tracker.cc:214] Successfully opened delta file 0 I0528 18:07:09.625401 31603 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:09.629303 31603 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:09.631860 31603 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:09.631908 31603 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 741}] I0528 18:07:09.637895 31603 delta_tracker.cc:528] Flushing 11 deltas... I0528 18:07:09.638846 31603 delta_tracker.cc:475] Flushed delta block: 237774ebf84f4a948cead2b6d188e2b8 I0528 18:07:09.639231 31603 delta_tracker.cc:487] Reopened delta block for read: 237774ebf84f4a948cead2b6d188e2b8 I0528 18:07:09.656817 31603 tablet.cc:1207] Flush successful on 10 rows (65846 bytes) I0528 18:07:09.743252 31602 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 0.250} I0528 18:07:09.993479 31602 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 0.500} I0528 18:07:10.243787 31602 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 0.751} I0528 18:07:10.494072 31602 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 1.001} W0528 18:07:10.708389 31573 thread.cc:359] Waited for 1000ms trying to join with test0 I0528 18:07:10.744339 31602 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/0", "time": 1.251} [ OK ] MultiThreadedTabletTest/0.DeleteAndReinsert (1540 ms) [----------] 2 tests from MultiThreadedTabletTest/0 (4255 ms total) [----------] 2 tests from MultiThreadedTabletTest/1, where TypeParam = kudu::tablet::IntKeyTestSetup<(kudu::DataType)0> [ RUN ] MultiThreadedTabletTest/1.DoTestAllAtOnce I0528 18:07:11.032870 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:11.033298 31625 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/1", "time": 0.000} W0528 18:07:11.033913 31627 tablet-test-base.h:762] Clamping max rows to 254 to prevent overflow W0528 18:07:11.033941 31627 mt-tablet-test.cc:66] Clamping the inserts per thread to 31 to prevent overflow W0528 18:07:11.034317 31628 tablet-test-base.h:762] Clamping max rows to 254 to prevent overflow W0528 18:07:11.034343 31628 mt-tablet-test.cc:66] Clamping the inserts per thread to 31 to prevent overflow W0528 18:07:11.034739 31629 tablet-test-base.h:762] Clamping max rows to 254 to prevent overflow W0528 18:07:11.034770 31629 mt-tablet-test.cc:66] Clamping the inserts per thread to 31 to prevent overflow W0528 18:07:11.035850 31630 tablet-test-base.h:762] Clamping max rows to 254 to prevent overflow W0528 18:07:11.035905 31630 mt-tablet-test.cc:66] Clamping the inserts per thread to 31 to prevent overflow W0528 18:07:11.036118 31631 tablet-test-base.h:762] Clamping max rows to 254 to prevent overflow W0528 18:07:11.036144 31631 mt-tablet-test.cc:66] Clamping the inserts per thread to 31 to prevent overflow W0528 18:07:11.036681 31632 tablet-test-base.h:762] Clamping max rows to 254 to prevent overflow W0528 18:07:11.036716 31632 mt-tablet-test.cc:66] Clamping the inserts per thread to 31 to prevent overflow W0528 18:07:11.038688 31633 tablet-test-base.h:762] Clamping max rows to 254 to prevent overflow W0528 18:07:11.038733 31633 mt-tablet-test.cc:66] Clamping the inserts per thread to 31 to prevent overflow W0528 18:07:11.041448 31634 tablet-test-base.h:762] Clamping max rows to 254 to prevent overflow W0528 18:07:11.041514 31634 mt-tablet-test.cc:66] Clamping the inserts per thread to 31 to prevent overflow W0528 18:07:11.054792 31646 tablet-test-base.h:762] Clamping max rows to 254 to prevent overflow I0528 18:07:11.057106 31647 mt-tablet-test.cc:88] Update thread using schema: Schema [key[uint8 NOT NULL], val[uint32 NOT NULL], update_count[uint32 NOT NULL]] I0528 18:07:11.084187 31573 mt-tablet-test.cc:358] Sum = 30628 I0528 18:07:11.084244 31573 mt-tablet-test.cc:356] Times for Summing int32 column: real 0.004s user 0.004s sys 0.000s W0528 18:07:11.084295 31573 tablet-test-base.h:762] Clamping max rows to 254 to prevent overflow I0528 18:07:11.095382 31573 tablet-test-base.h:736] Successfully verified 248rows [ OK ] MultiThreadedTabletTest/1.DoTestAllAtOnce (101 ms) [ RUN ] MultiThreadedTabletTest/1.DeleteAndReinsert I0528 18:07:11.136606 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:11.136914 31648 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/1", "time": 0.000} I0528 18:07:11.151289 31649 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:11.151346 31649 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:11.151383 31649 compaction.cc:551] memrowset(0 bytes) I0528 18:07:11.151437 31649 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:11.151466 31649 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:11.152639 31649 diskrowset.cc:94] Opened CFile writer for column key[uint8 NOT NULL] I0528 18:07:11.153209 31649 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:11.153554 31649 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:11.160315 31649 tablet.cc:1086] Flush resulted in no output rows (all input rows were GCed!) Removing all input rowsets. I0528 18:07:11.192069 31649 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:11.192591 31649 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:11.192642 31649 compaction.cc:551] memrowset(0 bytes) I0528 18:07:11.192685 31649 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:11.192733 31649 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:11.193641 31649 diskrowset.cc:94] Opened CFile writer for column key[uint8 NOT NULL] I0528 18:07:11.194214 31649 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:11.194720 31649 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] W0528 18:07:11.200803 31649 compaction.cc:654] Found REINSERT REDO truncating row history for Row: (uint8 key=0, uint32 val=0, uint32 update_count=1) Redo Mutations: [@11(SET update_count=0), @18(SET update_count=1), @21(SET update_count=2), @25(SET update_count=3), @27(DELETE), @93(REINSERT (uint8 key=0, uint32 val=0, uint32 update_count=1)), @94(SET update_count=7), @99(SET update_count=8), @106(SET update_count=9), @110(DELETE), @142(REINSERT (uint8 key=0, uint32 val=0, uint32 update_count=2)), @195(SET update_count=12), @200(DELETE), @212(REINSERT (uint8 key=0, uint32 val=0, uint32 update_count=3)), @216(SET update_count=15), @232(SET update_count=16), @237(DELETE), @271(REINSERT (uint8 key=0, uint32 val=0, uint32 update_count=4)), @278(SET update_count=18), @283(DELETE), @301(REINSERT (uint8 key=0, uint32 val=0, uint32 update_count=5)), @330(SET update_count=20), @338(SET update_count=21), @358(SET update_count=22), @368(DELETE)] Undo Mutations: [@2(DELETE)] Note: this warning will appear only for the first truncated row W0528 18:07:11.235317 31649 compaction.cc:764] Total 71 rows lost some history due to REINSERT after DELETE I0528 18:07:11.239194 31649 cfile_set.cc:71] Successfully opened cfile for column key[uint8 NOT NULL] in RowSet(1) I0528 18:07:11.239394 31649 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:11.239734 31649 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:11.240973 31649 delta_tracker.cc:214] Successfully opened delta file 0 I0528 18:07:11.241350 31649 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:11.249806 31649 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:11.252609 31649 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:11.252657 31649 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 656}] I0528 18:07:11.259621 31649 delta_tracker.cc:528] Flushing 9 deltas... I0528 18:07:11.260879 31649 delta_tracker.cc:475] Flushed delta block: ec847f8a45414c019ee1ed32407df65e I0528 18:07:11.261350 31649 delta_tracker.cc:487] Reopened delta block for read: ec847f8a45414c019ee1ed32407df65e I0528 18:07:11.277459 31649 tablet.cc:1207] Flush successful on 10 rows (65755 bytes) I0528 18:07:11.387110 31648 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/1", "time": 0.250} I0528 18:07:11.637351 31648 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/1", "time": 0.500} I0528 18:07:11.887603 31648 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/1", "time": 0.751} I0528 18:07:12.137904 31648 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/1", "time": 1.001} W0528 18:07:12.292286 31573 thread.cc:359] Waited for 1000ms trying to join with test0 I0528 18:07:12.388216 31648 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/1", "time": 1.251} I0528 18:07:12.638507 31648 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/1", "time": 1.502} [ OK ] MultiThreadedTabletTest/1.DeleteAndReinsert (1724 ms) [----------] 2 tests from MultiThreadedTabletTest/1 (1825 ms total) [----------] 2 tests from MultiThreadedTabletTest/2, where TypeParam = kudu::tablet::IntKeyTestSetup<(kudu::DataType)1> [ RUN ] MultiThreadedTabletTest/2.DoTestAllAtOnce I0528 18:07:12.854400 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:12.854960 31671 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/2", "time": 0.000} W0528 18:07:12.855541 31673 tablet-test-base.h:762] Clamping max rows to 126 to prevent overflow W0528 18:07:12.855578 31673 mt-tablet-test.cc:66] Clamping the inserts per thread to 15 to prevent overflow W0528 18:07:12.855847 31674 tablet-test-base.h:762] Clamping max rows to 126 to prevent overflow W0528 18:07:12.855875 31674 mt-tablet-test.cc:66] Clamping the inserts per thread to 15 to prevent overflow W0528 18:07:12.858456 31675 tablet-test-base.h:762] Clamping max rows to 126 to prevent overflow W0528 18:07:12.858487 31675 mt-tablet-test.cc:66] Clamping the inserts per thread to 15 to prevent overflow W0528 18:07:12.858857 31676 tablet-test-base.h:762] Clamping max rows to 126 to prevent overflow W0528 18:07:12.858883 31676 mt-tablet-test.cc:66] Clamping the inserts per thread to 15 to prevent overflow W0528 18:07:12.859366 31677 tablet-test-base.h:762] Clamping max rows to 126 to prevent overflow W0528 18:07:12.859397 31677 mt-tablet-test.cc:66] Clamping the inserts per thread to 15 to prevent overflow W0528 18:07:12.860090 31678 tablet-test-base.h:762] Clamping max rows to 126 to prevent overflow W0528 18:07:12.860123 31678 mt-tablet-test.cc:66] Clamping the inserts per thread to 15 to prevent overflow W0528 18:07:12.862380 31679 tablet-test-base.h:762] Clamping max rows to 126 to prevent overflow W0528 18:07:12.862412 31679 mt-tablet-test.cc:66] Clamping the inserts per thread to 15 to prevent overflow W0528 18:07:12.862622 31680 tablet-test-base.h:762] Clamping max rows to 126 to prevent overflow W0528 18:07:12.862656 31680 mt-tablet-test.cc:66] Clamping the inserts per thread to 15 to prevent overflow W0528 18:07:12.871050 31692 tablet-test-base.h:762] Clamping max rows to 126 to prevent overflow I0528 18:07:12.876282 31693 mt-tablet-test.cc:88] Update thread using schema: Schema [key[int8 NOT NULL], val[uint32 NOT NULL], update_count[uint32 NOT NULL]] I0528 18:07:12.901868 31573 mt-tablet-test.cc:358] Sum = 7140 I0528 18:07:12.901929 31573 mt-tablet-test.cc:356] Times for Summing int32 column: real 0.002s user 0.000s sys 0.000s W0528 18:07:12.901983 31573 tablet-test-base.h:762] Clamping max rows to 126 to prevent overflow I0528 18:07:12.907352 31573 tablet-test-base.h:736] Successfully verified 120rows [ OK ] MultiThreadedTabletTest/2.DoTestAllAtOnce (88 ms) [ RUN ] MultiThreadedTabletTest/2.DeleteAndReinsert I0528 18:07:12.946054 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:12.946686 31694 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/2", "time": 0.000} I0528 18:07:12.958982 31695 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:12.959059 31695 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:12.959101 31695 compaction.cc:551] memrowset(0 bytes) I0528 18:07:12.959144 31695 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:12.959189 31695 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:12.960119 31695 diskrowset.cc:94] Opened CFile writer for column key[int8 NOT NULL] I0528 18:07:12.960564 31695 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:12.961021 31695 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:12.968219 31695 tablet.cc:1086] Flush resulted in no output rows (all input rows were GCed!) Removing all input rowsets. I0528 18:07:13.010545 31695 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:13.010598 31695 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:13.010643 31695 compaction.cc:551] memrowset(0 bytes) I0528 18:07:13.010684 31695 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:13.010728 31695 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:13.011546 31695 diskrowset.cc:94] Opened CFile writer for column key[int8 NOT NULL] I0528 18:07:13.011788 31695 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:13.012115 31695 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] W0528 18:07:13.014607 31695 compaction.cc:654] Found REINSERT REDO truncating row history for Row: (int8 key=-8, uint32 val=8, uint32 update_count=1) Redo Mutations: [@15(DELETE), @22(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=1)), @41(DELETE), @52(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=2)), @61(DELETE), @69(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=3)), @76(DELETE), @85(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=4)), @93(DELETE), @113(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=5)), @120(DELETE), @127(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=6)), @179(DELETE), @187(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=7)), @198(DELETE), @207(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=8)), @214(DELETE), @219(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=9)), @233(DELETE), @249(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=10)), @261(DELETE)] Undo Mutations: [@8(DELETE)] Note: this warning will appear only for the first truncated row W0528 18:07:13.020841 31695 compaction.cc:764] Total 84 rows lost some history due to REINSERT after DELETE I0528 18:07:13.025962 31695 cfile_set.cc:71] Successfully opened cfile for column key[int8 NOT NULL] in RowSet(1) I0528 18:07:13.026219 31695 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:13.026783 31695 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:13.027335 31695 delta_tracker.cc:214] Successfully opened delta file 0 I0528 18:07:13.027722 31695 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:13.031780 31695 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:13.033748 31695 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:13.033805 31695 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 495}] I0528 18:07:13.041714 31695 delta_tracker.cc:528] Flushing 21 deltas... I0528 18:07:13.042644 31695 delta_tracker.cc:475] Flushed delta block: a270328adae944e4b3f6924f36db7e7b I0528 18:07:13.042983 31695 delta_tracker.cc:487] Reopened delta block for read: a270328adae944e4b3f6924f36db7e7b I0528 18:07:13.060184 31695 tablet.cc:1207] Flush successful on 10 rows (65755 bytes) I0528 18:07:13.087383 31695 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:13.087442 31695 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:13.087494 31695 compaction.cc:551] memrowset(0 bytes) I0528 18:07:13.087523 31695 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:13.087556 31695 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:13.088124 31695 diskrowset.cc:94] Opened CFile writer for column key[int8 NOT NULL] I0528 18:07:13.088418 31695 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:13.088671 31695 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] W0528 18:07:13.090638 31695 compaction.cc:654] Found REINSERT REDO truncating row history for Row: (int8 key=-8, uint32 val=8, uint32 update_count=12) Redo Mutations: [@280(SET update_count=3), @283(SET update_count=4), @286(DELETE), @294(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=12)), @305(DELETE), @315(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=13)), @322(SET update_count=7), @334(SET update_count=8), @337(SET update_count=9), @339(SET update_count=10), @344(SET update_count=11), @358(SET update_count=12), @367(DELETE), @376(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=14)), @399(SET update_count=14), @403(SET update_count=15), @406(DELETE), @490(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=15)), @500(DELETE), @508(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=16)), @520(DELETE), @537(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=17)), @543(DELETE), @558(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=18)), @567(DELETE), @578(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=19)), @604(SET update_count=22), @616(DELETE), @640(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=20)), @648(DELETE), @662(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=21)), @716(SET update_count=25), @723(DELETE), @729(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=22)), @748(SET update_count=26), @750(SET update_count=27), @751(DELETE), @755(REINSERT (int8 key=-8, uint32 val=8, uint32 update_count=23)), @767(SET update_count=29)] Undo Mutations: [@278(DELETE)] Note: this warning will appear only for the first truncated row W0528 18:07:13.098816 31695 compaction.cc:764] Total 105 rows lost some history due to REINSERT after DELETE I0528 18:07:13.101872 31695 cfile_set.cc:71] Successfully opened cfile for column key[int8 NOT NULL] in RowSet(2) I0528 18:07:13.102054 31695 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(2) I0528 18:07:13.102185 31695 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(2) I0528 18:07:13.102540 31695 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:13.106358 31695 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:13.110807 31695 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:13.110879 31695 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 900}] I0528 18:07:13.118293 31695 delta_tracker.cc:528] Flushing 20 deltas... I0528 18:07:13.119122 31695 delta_tracker.cc:475] Flushed delta block: 6969b7dcc99046b4af1d375032a4539a I0528 18:07:13.119504 31695 delta_tracker.cc:487] Reopened delta block for read: 6969b7dcc99046b4af1d375032a4539a I0528 18:07:13.132257 31695 tablet.cc:1207] Flush successful on 10 rows (65755 bytes) I0528 18:07:13.196832 31694 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/2", "time": 0.250} I0528 18:07:13.447037 31694 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/2", "time": 0.500} I0528 18:07:13.697187 31694 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/2", "time": 0.751} [ OK ] MultiThreadedTabletTest/2.DeleteAndReinsert (917 ms) [----------] 2 tests from MultiThreadedTabletTest/2 (1005 ms total) [----------] 2 tests from MultiThreadedTabletTest/3, where TypeParam = kudu::tablet::IntKeyTestSetup<(kudu::DataType)2> [ RUN ] MultiThreadedTabletTest/3.DoTestAllAtOnce I0528 18:07:13.862987 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:13.863308 31717 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/3", "time": 0.000} I0528 18:07:13.900373 31739 mt-tablet-test.cc:88] Update thread using schema: Schema [key[uint16 NOT NULL], val[uint32 NOT NULL], update_count[uint32 NOT NULL]] I0528 18:07:13.905999 31736 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:13.906139 31736 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:13.906185 31736 compaction.cc:551] memrowset(0 bytes) I0528 18:07:13.906219 31736 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:13.906250 31736 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:13.907938 31736 diskrowset.cc:94] Opened CFile writer for column key[uint16 NOT NULL] I0528 18:07:13.908236 31736 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:13.908447 31736 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:13.972053 31736 cfile_set.cc:71] Successfully opened cfile for column key[uint16 NOT NULL] in RowSet(0) I0528 18:07:13.972260 31736 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(0) I0528 18:07:13.972430 31736 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(0) I0528 18:07:13.972887 31736 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:13.976646 31736 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:13.979410 31736 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:13.979497 31736 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 1038}] I0528 18:07:14.010970 31736 delta_tracker.cc:528] Flushing 20 deltas... I0528 18:07:14.011920 31736 delta_tracker.cc:475] Flushed delta block: d555b83fd1704390b8ba8fea72df7fbd I0528 18:07:14.012213 31736 delta_tracker.cc:487] Reopened delta block for read: d555b83fd1704390b8ba8fea72df7fbd I0528 18:07:14.048471 31736 tablet.cc:1207] Flush successful on 368 rows (67670 bytes) I0528 18:07:14.052646 31736 delta_tracker.cc:528] Flushing 7 deltas... I0528 18:07:14.053509 31736 delta_tracker.cc:475] Flushed delta block: d091e5a0abb14d279fa089ce457b9fdb I0528 18:07:14.053877 31736 delta_tracker.cc:487] Reopened delta block for read: d091e5a0abb14d279fa089ce457b9fdb I0528 18:07:14.107530 31736 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:14.107599 31736 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:14.107645 31736 compaction.cc:551] memrowset(0 bytes) I0528 18:07:14.107689 31736 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:14.107729 31736 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:14.108561 31736 diskrowset.cc:94] Opened CFile writer for column key[uint16 NOT NULL] I0528 18:07:14.108954 31736 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:14.109447 31736 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:14.113453 31717 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/3", "time": 0.250, "inserted": 1122.000, "scanned": 4089.000, "updated": 30.000, "num_rowsets": 0.000, "memrowset_kb": 1536.000} I0528 18:07:14.304858 31736 cfile_set.cc:71] Successfully opened cfile for column key[uint16 NOT NULL] in RowSet(1) I0528 18:07:14.305066 31736 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:14.305233 31736 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:14.305779 31736 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:14.309435 31736 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:14.326831 31736 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:14.326892 31736 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 3054}] I0528 18:07:14.363674 31717 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/3", "time": 0.500, "inserted": 2856.000, "scanned": 12565.000, "updated": 70.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:14.458772 31736 tablet.cc:1207] Flush successful on 1247 rows (72474 bytes) I0528 18:07:14.467643 31736 delta_tracker.cc:528] Flushing 25 deltas... I0528 18:07:14.472601 31736 delta_tracker.cc:475] Flushed delta block: 216fe7bff0b0462f871bd2a285ffa59a I0528 18:07:14.473198 31736 delta_tracker.cc:487] Reopened delta block for read: 216fe7bff0b0462f871bd2a285ffa59a I0528 18:07:14.509389 31737 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:14.509452 31737 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:14.509490 31737 compaction.cc:551] RowSet(0)(2228 bytes) I0528 18:07:14.509539 31737 compaction.cc:551] RowSet(1)(7032 bytes) I0528 18:07:14.509589 31737 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:14.511270 31737 diskrowset.cc:94] Opened CFile writer for column key[uint16 NOT NULL] I0528 18:07:14.511586 31737 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:14.511884 31737 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:14.580018 31736 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:14.580088 31736 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:14.580131 31736 compaction.cc:551] memrowset(0 bytes) I0528 18:07:14.580169 31736 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:14.580209 31736 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:14.581573 31736 diskrowset.cc:94] Opened CFile writer for column key[uint16 NOT NULL] I0528 18:07:14.582789 31736 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:14.584317 31736 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:14.613898 31717 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/3", "time": 0.751, "inserted": 4366.000, "scanned": 23788.000, "updated": 100.000, "num_rowsets": 3.000, "memrowset_kb": 1536.000} I0528 18:07:14.666832 31737 cfile_set.cc:71] Successfully opened cfile for column key[uint16 NOT NULL] in RowSet(2) I0528 18:07:14.667029 31737 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(2) I0528 18:07:14.667194 31737 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(2) I0528 18:07:14.667697 31737 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:14.671676 31737 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:14.674273 31737 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:14.674343 31737 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 5182}] I0528 18:07:14.712926 31737 delta_tracker.cc:528] Flushing 14 deltas... I0528 18:07:14.713945 31737 delta_tracker.cc:475] Flushed delta block: f22c1c280afb4cbfa91c8a60e3432198 I0528 18:07:14.714311 31737 delta_tracker.cc:487] Reopened delta block for read: f22c1c280afb4cbfa91c8a60e3432198 I0528 18:07:14.749421 31737 tablet.cc:1207] Compaction successful on 1615 rows (74421 bytes) I0528 18:07:14.864114 31717 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/3", "time": 1.001, "inserted": 5794.000, "scanned": 36599.000, "updated": 140.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} W0528 18:07:14.900202 31573 thread.cc:359] Waited for 1000ms trying to join with test0 I0528 18:07:15.062368 31736 cfile_set.cc:71] Successfully opened cfile for column key[uint16 NOT NULL] in RowSet(3) I0528 18:07:15.062568 31736 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(3) I0528 18:07:15.062722 31736 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(3) I0528 18:07:15.063223 31736 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:15.067204 31736 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:15.075810 31736 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:15.075872 31736 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 7788}] I0528 18:07:15.114338 31717 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/3", "time": 1.251, "inserted": 7570.000, "scanned": 45539.000, "updated": 200.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:15.281472 31736 tablet.cc:1207] Flush successful on 2977 rows (81848 bytes) I0528 18:07:15.292430 31736 delta_tracker.cc:528] Flushing 130 deltas... I0528 18:07:15.294121 31736 delta_tracker.cc:475] Flushed delta block: bb847df6fae64eb780b4ab5fdd89b3e5 I0528 18:07:15.294368 31736 delta_tracker.cc:487] Reopened delta block for read: bb847df6fae64eb780b4ab5fdd89b3e5 I0528 18:07:15.364563 31717 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/3", "time": 1.501, "inserted": 8000.000, "scanned": 50121.000, "updated": 240.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:15.379041 31573 mt-tablet-test.cc:358] Sum = 31996000 I0528 18:07:15.379107 31573 mt-tablet-test.cc:356] Times for Summing int32 column: real 0.053s user 0.050s sys 0.000s I0528 18:07:15.554452 31573 tablet-test-base.h:736] Successfully verified 8000rows [ OK ] MultiThreadedTabletTest/3.DoTestAllAtOnce (1740 ms) [ RUN ] MultiThreadedTabletTest/3.DeleteAndReinsert I0528 18:07:15.600301 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:15.600767 31740 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/3", "time": 0.000} I0528 18:07:15.629245 31741 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:15.629328 31741 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:15.629389 31741 compaction.cc:551] memrowset(0 bytes) I0528 18:07:15.629442 31741 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:15.629492 31741 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:15.630442 31741 diskrowset.cc:94] Opened CFile writer for column key[uint16 NOT NULL] I0528 18:07:15.632253 31741 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:15.637828 31741 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:15.646427 31741 tablet.cc:1086] Flush resulted in no output rows (all input rows were GCed!) Removing all input rowsets. I0528 18:07:15.687857 31741 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:15.687919 31741 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:15.687963 31741 compaction.cc:551] memrowset(0 bytes) I0528 18:07:15.688004 31741 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:15.688040 31741 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:15.691347 31741 diskrowset.cc:94] Opened CFile writer for column key[uint16 NOT NULL] I0528 18:07:15.691928 31741 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:15.692348 31741 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] W0528 18:07:15.696892 31741 compaction.cc:654] Found REINSERT REDO truncating row history for Row: (uint16 key=0, uint32 val=0, uint32 update_count=1) Redo Mutations: [@49(DELETE), @56(REINSERT (uint16 key=0, uint32 val=0, uint32 update_count=1)), @66(DELETE), @73(REINSERT (uint16 key=0, uint32 val=0, uint32 update_count=2)), @86(DELETE), @93(REINSERT (uint16 key=0, uint32 val=0, uint32 update_count=3)), @120(SET update_count=4), @124(SET update_count=5), @128(SET update_count=6), @136(DELETE), @149(REINSERT (uint16 key=0, uint32 val=0, uint32 update_count=4)), @191(SET update_count=9), @202(SET update_count=10), @215(DELETE), @235(REINSERT (uint16 key=0, uint32 val=0, uint32 update_count=5)), @238(SET update_count=12), @242(DELETE), @287(REINSERT (uint16 key=0, uint32 val=0, uint32 update_count=6)), @291(SET update_count=14), @294(DELETE), @313(REINSERT (uint16 key=0, uint32 val=0, uint32 update_count=7)), @315(SET update_count=16), @326(DELETE), @336(REINSERT (uint16 key=0, uint32 val=0, uint32 update_count=8)), @338(SET update_count=18), @342(DELETE), @354(REINSERT (uint16 key=0, uint32 val=0, uint32 update_count=9)), @359(SET update_count=20), @362(DELETE), @425(REINSERT (uint16 key=0, uint32 val=0, uint32 update_count=10)), @439(SET update_count=26), @450(DELETE)] Undo Mutations: [@24(DELETE)] Note: this warning will appear only for the first truncated row W0528 18:07:15.705449 31741 compaction.cc:764] Total 105 rows lost some history due to REINSERT after DELETE I0528 18:07:15.709600 31741 cfile_set.cc:71] Successfully opened cfile for column key[uint16 NOT NULL] in RowSet(1) I0528 18:07:15.709800 31741 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:15.709942 31741 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:15.710361 31741 delta_tracker.cc:214] Successfully opened delta file 0 I0528 18:07:15.710743 31741 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:15.715556 31741 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:15.717636 31741 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:15.717692 31741 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 745}] I0528 18:07:15.724212 31741 delta_tracker.cc:528] Flushing 16 deltas... I0528 18:07:15.725350 31741 delta_tracker.cc:475] Flushed delta block: 69192a11dd874f2f8e109388f2e39d16 I0528 18:07:15.725723 31741 delta_tracker.cc:487] Reopened delta block for read: 69192a11dd874f2f8e109388f2e39d16 I0528 18:07:15.738422 31741 tablet.cc:1207] Flush successful on 10 rows (65767 bytes) I0528 18:07:15.850962 31740 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/3", "time": 0.250} I0528 18:07:16.101111 31740 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/3", "time": 0.500} I0528 18:07:16.351366 31740 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/3", "time": 0.751} I0528 18:07:16.601711 31740 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/3", "time": 1.001} I0528 18:07:16.851987 31740 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/3", "time": 1.251} [ OK ] MultiThreadedTabletTest/3.DeleteAndReinsert (1378 ms) [----------] 2 tests from MultiThreadedTabletTest/3 (3118 ms total) [----------] 2 tests from MultiThreadedTabletTest/4, where TypeParam = kudu::tablet::IntKeyTestSetup<(kudu::DataType)3> [ RUN ] MultiThreadedTabletTest/4.DoTestAllAtOnce I0528 18:07:16.971423 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:16.971840 31763 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 0.000} I0528 18:07:17.015032 31785 mt-tablet-test.cc:88] Update thread using schema: Schema [key[int16 NOT NULL], val[uint32 NOT NULL], update_count[uint32 NOT NULL]] I0528 18:07:17.022264 31782 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:17.022311 31782 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:17.022356 31782 compaction.cc:551] memrowset(0 bytes) I0528 18:07:17.022403 31782 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:17.022446 31782 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:17.024387 31782 diskrowset.cc:94] Opened CFile writer for column key[int16 NOT NULL] I0528 18:07:17.025856 31782 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:17.026271 31782 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:17.087184 31782 cfile_set.cc:71] Successfully opened cfile for column key[int16 NOT NULL] in RowSet(0) I0528 18:07:17.087340 31782 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(0) I0528 18:07:17.087487 31782 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(0) I0528 18:07:17.087887 31782 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:17.091204 31782 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:17.099620 31782 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:17.099678 31782 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 807}] I0528 18:07:17.175689 31782 delta_tracker.cc:528] Flushing 30 deltas... I0528 18:07:17.177350 31782 delta_tracker.cc:475] Flushed delta block: 94f40f5fe8dc45788dff6849d9ccca1b I0528 18:07:17.177804 31782 delta_tracker.cc:487] Reopened delta block for read: 94f40f5fe8dc45788dff6849d9ccca1b I0528 18:07:17.191226 31782 tablet.cc:1207] Flush successful on 399 rows (67843 bytes) I0528 18:07:17.195029 31782 delta_tracker.cc:528] Flushing 5 deltas... I0528 18:07:17.195852 31782 delta_tracker.cc:475] Flushed delta block: 849a7d5e88a54081a4d850d21de7dce4 I0528 18:07:17.199798 31782 delta_tracker.cc:487] Reopened delta block for read: 849a7d5e88a54081a4d850d21de7dce4 I0528 18:07:17.222034 31763 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 0.250, "inserted": 816.000, "scanned": 4906.000, "updated": 40.000, "num_rowsets": 0.000, "memrowset_kb": 1536.000} I0528 18:07:17.251243 31782 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:17.251304 31782 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:17.251354 31782 compaction.cc:551] memrowset(0 bytes) I0528 18:07:17.251397 31782 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:17.251451 31782 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:17.254995 31782 diskrowset.cc:94] Opened CFile writer for column key[int16 NOT NULL] I0528 18:07:17.255491 31782 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:17.255739 31782 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:17.410141 31782 cfile_set.cc:71] Successfully opened cfile for column key[int16 NOT NULL] in RowSet(1) I0528 18:07:17.410362 31782 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:17.410524 31782 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:17.410933 31782 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:17.415190 31782 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:17.417026 31782 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:17.417354 31782 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2448}] I0528 18:07:17.472261 31763 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 0.500, "inserted": 2346.000, "scanned": 14729.000, "updated": 110.000, "num_rowsets": 1.000, "memrowset_kb": 1536.000} I0528 18:07:17.494428 31782 delta_tracker.cc:528] Flushing 55 deltas... I0528 18:07:17.501948 31782 delta_tracker.cc:475] Flushed delta block: 75a938bbc9b64ad2a10ec81312750d14 I0528 18:07:17.502431 31782 delta_tracker.cc:487] Reopened delta block for read: 75a938bbc9b64ad2a10ec81312750d14 I0528 18:07:17.524394 31783 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:17.524452 31783 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:17.524495 31783 compaction.cc:551] RowSet(0)(2401 bytes) I0528 18:07:17.524552 31783 compaction.cc:551] RowSet(1)(5767 bytes) I0528 18:07:17.524608 31783 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:17.526427 31783 diskrowset.cc:94] Opened CFile writer for column key[int16 NOT NULL] I0528 18:07:17.526897 31783 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:17.527197 31783 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:17.530077 31782 tablet.cc:1207] Flush successful on 1022 rows (71209 bytes) I0528 18:07:17.539659 31782 delta_tracker.cc:528] Flushing 17 deltas... I0528 18:07:17.540902 31782 delta_tracker.cc:475] Flushed delta block: 5740df366e7a41a8b0d0ce938cd1dd38 I0528 18:07:17.541254 31782 delta_tracker.cc:487] Reopened delta block for read: 5740df366e7a41a8b0d0ce938cd1dd38 I0528 18:07:17.631512 31782 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:17.631582 31782 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:17.631623 31782 compaction.cc:551] memrowset(0 bytes) I0528 18:07:17.631660 31782 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:17.631700 31782 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:17.636031 31782 diskrowset.cc:94] Opened CFile writer for column key[int16 NOT NULL] I0528 18:07:17.636514 31782 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:17.636935 31782 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:17.653383 31783 cfile_set.cc:71] Successfully opened cfile for column key[int16 NOT NULL] in RowSet(2) I0528 18:07:17.654294 31783 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(2) I0528 18:07:17.654520 31783 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(2) I0528 18:07:17.655529 31783 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:17.659503 31783 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:17.662922 31783 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:17.662992 31783 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 3809}] I0528 18:07:17.699403 31783 delta_tracker.cc:528] Flushing 26 deltas... I0528 18:07:17.703871 31783 delta_tracker.cc:475] Flushed delta block: 7b1253fe65ed42969ee360fc9073048b I0528 18:07:17.704782 31783 delta_tracker.cc:487] Reopened delta block for read: 7b1253fe65ed42969ee360fc9073048b I0528 18:07:17.722484 31763 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 0.751, "inserted": 3570.000, "scanned": 27398.000, "updated": 150.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:17.727311 31783 tablet.cc:1207] Compaction successful on 1421 rows (73329 bytes) I0528 18:07:17.908403 31782 cfile_set.cc:71] Successfully opened cfile for column key[int16 NOT NULL] in RowSet(3) I0528 18:07:17.908589 31782 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(3) I0528 18:07:17.908742 31782 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(3) I0528 18:07:17.909173 31782 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:17.912310 31782 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:17.918472 31782 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:17.919113 31782 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 5183}] I0528 18:07:17.972712 31763 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 1.001, "inserted": 4896.000, "scanned": 39062.000, "updated": 220.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} W0528 18:07:18.014968 31573 thread.cc:359] Waited for 1000ms trying to join with test0 I0528 18:07:18.100620 31782 delta_tracker.cc:528] Flushing 76 deltas... I0528 18:07:18.104312 31782 delta_tracker.cc:475] Flushed delta block: 465a74e785f7484f88248f8ec35d6ffa I0528 18:07:18.104734 31782 delta_tracker.cc:487] Reopened delta block for read: 465a74e785f7484f88248f8ec35d6ffa I0528 18:07:18.129083 31783 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:18.129137 31783 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:18.129164 31783 compaction.cc:551] RowSet(2)(7887 bytes) I0528 18:07:18.129206 31783 compaction.cc:551] RowSet(3)(11698 bytes) I0528 18:07:18.129248 31783 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:18.130362 31783 diskrowset.cc:94] Opened CFile writer for column key[int16 NOT NULL] I0528 18:07:18.130620 31783 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:18.130949 31783 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:18.141298 31782 tablet.cc:1207] Flush successful on 2121 rows (77140 bytes) I0528 18:07:18.222909 31763 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 1.251, "inserted": 6324.000, "scanned": 51671.000, "updated": 280.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:18.308521 31782 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:18.308599 31782 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:18.308645 31782 compaction.cc:551] memrowset(0 bytes) I0528 18:07:18.308688 31782 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:18.308732 31782 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:18.309512 31782 diskrowset.cc:94] Opened CFile writer for column key[int16 NOT NULL] I0528 18:07:18.309836 31782 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:18.310144 31782 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:18.445811 31783 cfile_set.cc:71] Successfully opened cfile for column key[int16 NOT NULL] in RowSet(4) I0528 18:07:18.446048 31783 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(4) I0528 18:07:18.446261 31783 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(4) I0528 18:07:18.446811 31783 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:18.450670 31783 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:18.451550 31783 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:18.451591 31783 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 7879}] I0528 18:07:18.473140 31763 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 1.501, "inserted": 7386.000, "scanned": 66588.000, "updated": 330.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:18.523345 31783 delta_tracker.cc:528] Flushing 100 deltas... I0528 18:07:18.525954 31783 delta_tracker.cc:475] Flushed delta block: 607336c869e04dbab6e04a8b7231d916 I0528 18:07:18.526408 31783 delta_tracker.cc:487] Reopened delta block for read: 607336c869e04dbab6e04a8b7231d916 I0528 18:07:18.574462 31783 tablet.cc:1207] Compaction successful on 3542 rows (84953 bytes) I0528 18:07:18.723371 31763 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 1.752, "inserted": 8000.000, "scanned": 83063.000, "updated": 370.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:18.737889 31782 cfile_set.cc:71] Successfully opened cfile for column key[int16 NOT NULL] in RowSet(5) I0528 18:07:18.738039 31782 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(5) I0528 18:07:18.738155 31782 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(5) I0528 18:07:18.738487 31782 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:18.740577 31782 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:18.740775 31782 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:18.740802 31782 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 8377}] I0528 18:07:18.899126 31782 tablet.cc:1207] Flush successful on 3445 rows (84423 bytes) I0528 18:07:18.914070 31782 delta_tracker.cc:528] Flushing 27 deltas... I0528 18:07:18.914937 31782 delta_tracker.cc:475] Flushed delta block: 12c577cb92ad4029814f7b185358a294 I0528 18:07:18.915215 31782 delta_tracker.cc:487] Reopened delta block for read: 12c577cb92ad4029814f7b185358a294 I0528 18:07:18.959732 31573 mt-tablet-test.cc:358] Sum = 31996000 I0528 18:07:18.959801 31573 mt-tablet-test.cc:356] Times for Summing int32 column: real 0.018s user 0.020s sys 0.000s I0528 18:07:18.973606 31763 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 2.002, "inserted": 8000.000, "scanned": 83063.000, "updated": 370.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:19.029621 31573 tablet-test-base.h:736] Successfully verified 8000rows [ OK ] MultiThreadedTabletTest/4.DoTestAllAtOnce (2099 ms) [ RUN ] MultiThreadedTabletTest/4.DeleteAndReinsert I0528 18:07:19.079653 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:19.080122 31786 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 0.000} I0528 18:07:19.131127 31787 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:19.131312 31787 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:19.131361 31787 compaction.cc:551] memrowset(0 bytes) I0528 18:07:19.131413 31787 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:19.131459 31787 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:19.132403 31787 diskrowset.cc:94] Opened CFile writer for column key[int16 NOT NULL] I0528 18:07:19.132875 31787 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:19.134173 31787 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:19.137269 31787 tablet.cc:1086] Flush resulted in no output rows (all input rows were GCed!) Removing all input rowsets. I0528 18:07:19.177836 31787 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:19.177894 31787 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:19.177924 31787 compaction.cc:551] memrowset(0 bytes) I0528 18:07:19.177955 31787 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:19.177984 31787 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:19.178627 31787 diskrowset.cc:94] Opened CFile writer for column key[int16 NOT NULL] I0528 18:07:19.179263 31787 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:19.179945 31787 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] W0528 18:07:19.183495 31787 compaction.cc:654] Found REINSERT REDO truncating row history for Row: (int16 key=-8, uint32 val=8, uint32 update_count=1) Redo Mutations: [@10(SET update_count=0), @16(SET update_count=1), @17(DELETE), @48(REINSERT (int16 key=-8, uint32 val=8, uint32 update_count=1)), @58(SET update_count=3), @79(DELETE), @99(REINSERT (int16 key=-8, uint32 val=8, uint32 update_count=2)), @104(SET update_count=5), @107(SET update_count=6), @112(SET update_count=7), @115(DELETE), @124(REINSERT (int16 key=-8, uint32 val=8, uint32 update_count=3)), @126(SET update_count=10), @131(SET update_count=11), @133(SET update_count=12), @137(SET update_count=13), @139(DELETE), @150(REINSERT (int16 key=-8, uint32 val=8, uint32 update_count=4)), @194(SET update_count=16), @198(DELETE), @208(REINSERT (int16 key=-8, uint32 val=8, uint32 update_count=5)), @264(SET update_count=19), @269(SET update_count=20), @270(DELETE)] Undo Mutations: [@7(DELETE)] Note: this warning will appear only for the first truncated row W0528 18:07:19.189780 31787 compaction.cc:764] Total 58 rows lost some history due to REINSERT after DELETE I0528 18:07:19.193089 31787 cfile_set.cc:71] Successfully opened cfile for column key[int16 NOT NULL] in RowSet(1) I0528 18:07:19.193291 31787 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:19.193969 31787 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:19.194566 31787 delta_tracker.cc:214] Successfully opened delta file 0 I0528 18:07:19.195302 31787 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:19.198212 31787 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:19.201763 31787 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:19.201833 31787 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 513}] I0528 18:07:19.206958 31787 delta_tracker.cc:528] Flushing 2 deltas... I0528 18:07:19.207644 31787 delta_tracker.cc:475] Flushed delta block: 488556fd516f46e8ad0251df16aafb9d I0528 18:07:19.208132 31787 delta_tracker.cc:487] Reopened delta block for read: 488556fd516f46e8ad0251df16aafb9d I0528 18:07:19.230478 31787 tablet.cc:1207] Flush successful on 10 rows (65767 bytes) I0528 18:07:19.330265 31786 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 0.250} I0528 18:07:19.580430 31786 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 0.500} I0528 18:07:19.830683 31786 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 0.751} I0528 18:07:20.081009 31786 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 1.001} W0528 18:07:20.255250 31573 thread.cc:359] Waited for 1000ms trying to join with test0 I0528 18:07:20.331336 31786 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 1.251} I0528 18:07:20.581707 31786 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/4", "time": 1.502} [ OK ] MultiThreadedTabletTest/4.DeleteAndReinsert (1675 ms) [----------] 2 tests from MultiThreadedTabletTest/4 (3774 ms total) [----------] 2 tests from MultiThreadedTabletTest/5, where TypeParam = kudu::tablet::IntKeyTestSetup<(kudu::DataType)4> [ RUN ] MultiThreadedTabletTest/5.DoTestAllAtOnce I0528 18:07:20.760237 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:20.760591 31809 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/5", "time": 0.000} I0528 18:07:20.820171 31831 mt-tablet-test.cc:88] Update thread using schema: Schema [key[uint32 NOT NULL], val[uint32 NOT NULL], update_count[uint32 NOT NULL]] I0528 18:07:20.830869 31828 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:20.830945 31828 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:20.830989 31828 compaction.cc:551] memrowset(0 bytes) I0528 18:07:20.831037 31828 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:20.831080 31828 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:20.832309 31828 diskrowset.cc:94] Opened CFile writer for column key[uint32 NOT NULL] I0528 18:07:20.832566 31828 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:20.832818 31828 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:20.923720 31828 cfile_set.cc:71] Successfully opened cfile for column key[uint32 NOT NULL] in RowSet(0) I0528 18:07:20.926352 31828 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(0) I0528 18:07:20.928644 31828 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(0) I0528 18:07:20.929244 31828 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:20.932379 31828 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:20.934666 31828 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:20.934715 31828 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 1210}] I0528 18:07:20.994619 31828 delta_tracker.cc:528] Flushing 33 deltas... I0528 18:07:20.996789 31828 delta_tracker.cc:475] Flushed delta block: 3bdd746e71e4448aaa74d7442551b2bd I0528 18:07:20.999874 31828 delta_tracker.cc:487] Reopened delta block for read: 3bdd746e71e4448aaa74d7442551b2bd I0528 18:07:21.010797 31809 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/5", "time": 0.250, "inserted": 1632.000, "scanned": 3913.000, "updated": 30.000, "num_rowsets": 0.000, "memrowset_kb": 1536.000} I0528 18:07:21.028708 31828 tablet.cc:1207] Flush successful on 481 rows (68350 bytes) I0528 18:07:21.033012 31828 delta_tracker.cc:528] Flushing 8 deltas... I0528 18:07:21.033972 31828 delta_tracker.cc:475] Flushed delta block: 8a3ed92af7f34a108377e4efd459433e I0528 18:07:21.034373 31828 delta_tracker.cc:487] Reopened delta block for read: 8a3ed92af7f34a108377e4efd459433e I0528 18:07:21.087232 31828 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:21.088155 31828 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:21.088212 31828 compaction.cc:551] memrowset(0 bytes) I0528 18:07:21.088260 31828 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:21.088307 31828 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:21.089112 31828 diskrowset.cc:94] Opened CFile writer for column key[uint32 NOT NULL] I0528 18:07:21.089452 31828 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:21.089833 31828 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:21.261026 31809 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/5", "time": 0.500, "inserted": 2652.000, "scanned": 11616.000, "updated": 80.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:21.346675 31828 cfile_set.cc:71] Successfully opened cfile for column key[uint32 NOT NULL] in RowSet(1) I0528 18:07:21.346822 31828 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:21.346966 31828 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:21.347295 31828 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:21.351155 31828 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:21.355499 31828 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:21.355578 31828 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 3822}] I0528 18:07:21.511242 31809 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/5", "time": 0.751, "inserted": 4488.000, "scanned": 19666.000, "updated": 110.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:21.526701 31828 tablet.cc:1207] Flush successful on 1794 rows (75536 bytes) I0528 18:07:21.531074 31828 delta_tracker.cc:528] Flushing 42 deltas... I0528 18:07:21.532693 31828 delta_tracker.cc:475] Flushed delta block: 1ad241fb4356400d8fc31ec0d65dfbc5 I0528 18:07:21.533076 31828 delta_tracker.cc:487] Reopened delta block for read: 1ad241fb4356400d8fc31ec0d65dfbc5 I0528 18:07:21.536927 31829 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:21.536981 31829 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:21.537010 31829 compaction.cc:551] RowSet(0)(2910 bytes) I0528 18:07:21.537049 31829 compaction.cc:551] RowSet(1)(10096 bytes) I0528 18:07:21.537086 31829 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:21.538244 31829 diskrowset.cc:94] Opened CFile writer for column key[uint32 NOT NULL] I0528 18:07:21.540086 31829 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:21.540313 31829 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:21.614997 31828 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:21.615080 31828 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:21.615125 31828 compaction.cc:551] memrowset(0 bytes) I0528 18:07:21.615169 31828 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:21.615216 31828 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:21.616008 31828 diskrowset.cc:94] Opened CFile writer for column key[uint32 NOT NULL] I0528 18:07:21.616389 31828 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:21.617496 31828 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:21.749655 31829 cfile_set.cc:71] Successfully opened cfile for column key[uint32 NOT NULL] in RowSet(2) I0528 18:07:21.749858 31829 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(2) I0528 18:07:21.750025 31829 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(2) I0528 18:07:21.750520 31829 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:21.754348 31829 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:21.755652 31829 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:21.755715 31829 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 6407}] I0528 18:07:21.761466 31809 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/5", "time": 1.001, "inserted": 5896.000, "scanned": 28717.000, "updated": 140.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:21.811791 31829 delta_tracker.cc:528] Flushing 34 deltas... I0528 18:07:21.813148 31829 delta_tracker.cc:475] Flushed delta block: 149b7ac72dae4261a366d08782dd85f8 I0528 18:07:21.813545 31829 delta_tracker.cc:487] Reopened delta block for read: 149b7ac72dae4261a366d08782dd85f8 W0528 18:07:21.819989 31573 thread.cc:359] Waited for 1000ms trying to join with test0 I0528 18:07:21.839685 31829 tablet.cc:1207] Compaction successful on 2275 rows (78298 bytes) I0528 18:07:22.011698 31809 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/5", "time": 1.251, "inserted": 7550.000, "scanned": 38011.000, "updated": 190.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:22.045861 31828 cfile_set.cc:71] Successfully opened cfile for column key[uint32 NOT NULL] in RowSet(3) I0528 18:07:22.046121 31828 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(3) I0528 18:07:22.046303 31828 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(3) I0528 18:07:22.046800 31828 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:22.050554 31828 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:22.053580 31828 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:22.053730 31828 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 8016}] I0528 18:07:22.246217 31828 tablet.cc:1207] Flush successful on 3311 rows (84257 bytes) I0528 18:07:22.261009 31828 delta_tracker.cc:528] Flushing 69 deltas... I0528 18:07:22.261905 31809 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/5", "time": 1.501, "inserted": 8000.000, "scanned": 49514.000, "updated": 220.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:22.262215 31828 delta_tracker.cc:475] Flushed delta block: 71ec235337094ca096fa17f8379f9854 I0528 18:07:22.262455 31828 delta_tracker.cc:487] Reopened delta block for read: 71ec235337094ca096fa17f8379f9854 I0528 18:07:22.334003 31573 mt-tablet-test.cc:358] Sum = 31996000 I0528 18:07:22.334077 31573 mt-tablet-test.cc:356] Times for Summing int32 column: real 0.037s user 0.036s sys 0.000s I0528 18:07:22.463881 31573 tablet-test-base.h:736] Successfully verified 8000rows [ OK ] MultiThreadedTabletTest/5.DoTestAllAtOnce (1756 ms) [ RUN ] MultiThreadedTabletTest/5.DeleteAndReinsert I0528 18:07:22.501191 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:22.501790 31832 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/5", "time": 0.000} I0528 18:07:22.533640 31833 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:22.533712 31833 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:22.533757 31833 compaction.cc:551] memrowset(0 bytes) I0528 18:07:22.533797 31833 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:22.533838 31833 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:22.537528 31833 diskrowset.cc:94] Opened CFile writer for column key[uint32 NOT NULL] I0528 18:07:22.538494 31833 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:22.538852 31833 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:22.545653 31833 tablet.cc:1086] Flush resulted in no output rows (all input rows were GCed!) Removing all input rowsets. I0528 18:07:22.585094 31833 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:22.585181 31833 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:22.585222 31833 compaction.cc:551] memrowset(0 bytes) I0528 18:07:22.585263 31833 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:22.585305 31833 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:22.585958 31833 diskrowset.cc:94] Opened CFile writer for column key[uint32 NOT NULL] I0528 18:07:22.586542 31833 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:22.587038 31833 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] W0528 18:07:22.590389 31833 compaction.cc:654] Found REINSERT REDO truncating row history for Row: (uint32 key=0, uint32 val=0, uint32 update_count=1) Redo Mutations: [@36(DELETE), @58(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=1)), @62(SET update_count=2), @66(SET update_count=3), @94(DELETE), @119(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=2)), @126(DELETE), @145(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=3)), @151(DELETE), @173(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=4)), @181(SET update_count=7), @187(SET update_count=8), @208(SET update_count=9), @218(DELETE), @234(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=5)), @249(SET update_count=12), @252(SET update_count=13), @272(DELETE), @303(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=6)), @306(SET update_count=16), @308(DELETE), @344(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=7)), @350(SET update_count=19), @376(DELETE)] Undo Mutations: [@4(DELETE)] Note: this warning will appear only for the first truncated row W0528 18:07:22.595599 31833 compaction.cc:764] Total 78 rows lost some history due to REINSERT after DELETE I0528 18:07:22.598821 31833 cfile_set.cc:71] Successfully opened cfile for column key[uint32 NOT NULL] in RowSet(1) I0528 18:07:22.599031 31833 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:22.599215 31833 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:22.599730 31833 delta_tracker.cc:214] Successfully opened delta file 0 I0528 18:07:22.600147 31833 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:22.604249 31833 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:22.606066 31833 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:22.606130 31833 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 556}] I0528 18:07:22.614702 31833 delta_tracker.cc:528] Flushing 7 deltas... I0528 18:07:22.617249 31833 delta_tracker.cc:475] Flushed delta block: b704cba4cf804a4393902797458c6242 I0528 18:07:22.617794 31833 delta_tracker.cc:487] Reopened delta block for read: b704cba4cf804a4393902797458c6242 I0528 18:07:22.634780 31833 tablet.cc:1207] Flush successful on 10 rows (65763 bytes) I0528 18:07:22.667750 31833 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:22.667834 31833 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:22.667886 31833 compaction.cc:551] memrowset(0 bytes) I0528 18:07:22.667935 31833 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:22.667989 31833 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:22.674835 31833 diskrowset.cc:94] Opened CFile writer for column key[uint32 NOT NULL] I0528 18:07:22.675246 31833 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:22.675709 31833 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] W0528 18:07:22.680485 31833 compaction.cc:654] Found REINSERT REDO truncating row history for Row: (uint32 key=0, uint32 val=0, uint32 update_count=9) Redo Mutations: [@459(SET update_count=21), @464(SET update_count=22), @466(DELETE), @489(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=9)), @518(SET update_count=25), @521(SET update_count=26), @526(SET update_count=27), @531(DELETE), @545(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=10)), @548(SET update_count=30), @562(DELETE), @580(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=11)), @599(SET update_count=32), @601(DELETE), @610(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=12)), @618(SET update_count=34), @622(SET update_count=35), @625(DELETE), @631(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=13)), @647(SET update_count=37), @649(DELETE), @707(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=14)), @718(SET update_count=42), @726(DELETE), @732(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=15)), @737(SET update_count=44), @746(DELETE), @766(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=16)), @770(SET update_count=46), @772(DELETE), @775(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=17)), @799(SET update_count=48), @809(DELETE), @832(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=18)), @838(SET update_count=50), @847(DELETE)] Undo Mutations: [@455(DELETE)] Note: this warning will appear only for the first truncated row W0528 18:07:22.686862 31833 compaction.cc:764] Total 97 rows lost some history due to REINSERT after DELETE I0528 18:07:22.689985 31833 cfile_set.cc:71] Successfully opened cfile for column key[uint32 NOT NULL] in RowSet(2) I0528 18:07:22.690194 31833 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(2) I0528 18:07:22.690371 31833 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(2) I0528 18:07:22.690909 31833 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:22.694648 31833 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:22.699091 31833 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:22.699156 31833 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 1001}] I0528 18:07:22.706240 31833 delta_tracker.cc:528] Flushing 18 deltas... I0528 18:07:22.707077 31833 delta_tracker.cc:475] Flushed delta block: 75d80a10fa774b4d87d8c83f7d85a7e9 I0528 18:07:22.707403 31833 delta_tracker.cc:487] Reopened delta block for read: 75d80a10fa774b4d87d8c83f7d85a7e9 I0528 18:07:22.722131 31833 tablet.cc:1207] Flush successful on 10 rows (65763 bytes) I0528 18:07:22.751977 31832 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/5", "time": 0.250} I0528 18:07:23.002132 31832 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/5", "time": 0.500} I0528 18:07:23.252288 31832 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/5", "time": 0.751} [ OK ] MultiThreadedTabletTest/5.DeleteAndReinsert (970 ms) [----------] 2 tests from MultiThreadedTabletTest/5 (2726 ms total) [----------] 2 tests from MultiThreadedTabletTest/6, where TypeParam = kudu::tablet::IntKeyTestSetup<(kudu::DataType)5> [ RUN ] MultiThreadedTabletTest/6.DoTestAllAtOnce I0528 18:07:23.479655 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:23.480332 31855 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 0.000} I0528 18:07:23.511756 31874 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:23.511833 31874 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:23.511881 31874 compaction.cc:551] memrowset(0 bytes) I0528 18:07:23.511935 31874 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:23.511971 31874 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:23.513547 31874 diskrowset.cc:94] Opened CFile writer for column key[int32 NOT NULL] I0528 18:07:23.514031 31874 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:23.514350 31874 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:23.516613 31877 mt-tablet-test.cc:88] Update thread using schema: Schema [key[int32 NOT NULL], val[uint32 NOT NULL], update_count[uint32 NOT NULL]] I0528 18:07:23.547216 31874 cfile_set.cc:71] Successfully opened cfile for column key[int32 NOT NULL] in RowSet(0) I0528 18:07:23.547826 31874 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(0) I0528 18:07:23.548095 31874 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(0) I0528 18:07:23.549435 31874 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:23.553822 31874 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:23.560000 31874 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:23.560056 31874 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 406}] I0528 18:07:23.580937 31874 delta_tracker.cc:528] Flushing 12 deltas... I0528 18:07:23.582620 31874 delta_tracker.cc:475] Flushed delta block: 61668537141d44f9abdc671b73123acf I0528 18:07:23.583508 31874 delta_tracker.cc:487] Reopened delta block for read: 61668537141d44f9abdc671b73123acf I0528 18:07:23.605377 31874 tablet.cc:1207] Flush successful on 196 rows (67154 bytes) I0528 18:07:23.609922 31874 delta_tracker.cc:528] Flushing 7 deltas... I0528 18:07:23.610754 31874 delta_tracker.cc:475] Flushed delta block: ecd9fca7c4c7465fbf5f2490097fccc2 I0528 18:07:23.611269 31874 delta_tracker.cc:487] Reopened delta block for read: ecd9fca7c4c7465fbf5f2490097fccc2 I0528 18:07:23.665388 31874 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:23.665472 31874 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:23.665525 31874 compaction.cc:551] memrowset(0 bytes) I0528 18:07:23.665575 31874 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:23.665624 31874 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:23.666549 31874 diskrowset.cc:94] Opened CFile writer for column key[int32 NOT NULL] I0528 18:07:23.667332 31874 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:23.667809 31874 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:23.730553 31855 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 0.250, "inserted": 918.000, "scanned": 6243.000, "updated": 40.000, "num_rowsets": 0.000, "memrowset_kb": 1536.000} I0528 18:07:23.803028 31874 cfile_set.cc:71] Successfully opened cfile for column key[int32 NOT NULL] in RowSet(1) I0528 18:07:23.803306 31874 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:23.803529 31874 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:23.804016 31874 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:23.808524 31874 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:23.823355 31874 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:23.824697 31874 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 1882}] I0528 18:07:23.882339 31874 delta_tracker.cc:528] Flushing 41 deltas... I0528 18:07:23.884179 31874 delta_tracker.cc:475] Flushed delta block: 8d809829c9684cef8d30f419e70c5487 I0528 18:07:23.884711 31874 delta_tracker.cc:487] Reopened delta block for read: 8d809829c9684cef8d30f419e70c5487 I0528 18:07:23.902477 31874 tablet.cc:1207] Flush successful on 833 rows (71847 bytes) I0528 18:07:23.907222 31874 delta_tracker.cc:528] Flushing 15 deltas... I0528 18:07:23.908212 31874 delta_tracker.cc:475] Flushed delta block: 3e17d6e845cf48d68a42b94d73cabacf I0528 18:07:23.908491 31874 delta_tracker.cc:487] Reopened delta block for read: 3e17d6e845cf48d68a42b94d73cabacf I0528 18:07:23.924453 31875 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:23.924509 31875 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:23.924538 31875 compaction.cc:551] RowSet(0)(1714 bytes) I0528 18:07:23.924577 31875 compaction.cc:551] RowSet(1)(6407 bytes) I0528 18:07:23.924615 31875 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:23.926555 31875 diskrowset.cc:94] Opened CFile writer for column key[int32 NOT NULL] I0528 18:07:23.926780 31875 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:23.927024 31875 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:23.980798 31855 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 0.500, "inserted": 2244.000, "scanned": 14839.000, "updated": 100.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:23.991204 31874 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:23.991291 31874 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:23.991325 31874 compaction.cc:551] memrowset(0 bytes) I0528 18:07:23.991358 31874 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:23.991390 31874 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:23.992754 31874 diskrowset.cc:94] Opened CFile writer for column key[int32 NOT NULL] I0528 18:07:23.994251 31874 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:23.995228 31874 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:24.046522 31875 cfile_set.cc:71] Successfully opened cfile for column key[int32 NOT NULL] in RowSet(2) I0528 18:07:24.047709 31875 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(2) I0528 18:07:24.048193 31875 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(2) I0528 18:07:24.048851 31875 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:24.059399 31875 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:24.063915 31875 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:24.063993 31875 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2956}] I0528 18:07:24.097375 31875 tablet.cc:1207] Compaction successful on 1029 rows (73276 bytes) I0528 18:07:24.222695 31874 cfile_set.cc:71] Successfully opened cfile for column key[int32 NOT NULL] in RowSet(3) I0528 18:07:24.223024 31874 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(3) I0528 18:07:24.223450 31874 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(3) I0528 18:07:24.223933 31874 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:24.228369 31874 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:24.231026 31874 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:24.231026 31855 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 0.751, "inserted": 3264.000, "scanned": 28350.000, "updated": 180.000, "num_rowsets": 3.000, "memrowset_kb": 1536.000} I0528 18:07:24.231117 31874 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 3908}] I0528 18:07:24.360375 31874 delta_tracker.cc:528] Flushing 93 deltas... I0528 18:07:24.362802 31874 delta_tracker.cc:475] Flushed delta block: dec8bc8151eb411395833eb650193ea4 I0528 18:07:24.363243 31874 delta_tracker.cc:487] Reopened delta block for read: dec8bc8151eb411395833eb650193ea4 I0528 18:07:24.380343 31874 tablet.cc:1207] Flush successful on 1569 rows (77263 bytes) I0528 18:07:24.384162 31874 delta_tracker.cc:528] Flushing 15 deltas... I0528 18:07:24.385239 31874 delta_tracker.cc:475] Flushed delta block: ffc991eb6e124d429a463508d3a5151b I0528 18:07:24.385632 31874 delta_tracker.cc:487] Reopened delta block for read: ffc991eb6e124d429a463508d3a5151b I0528 18:07:24.399127 31875 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:24.399199 31875 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:24.399238 31875 compaction.cc:551] RowSet(2)(7836 bytes) I0528 18:07:24.399291 31875 compaction.cc:551] RowSet(3)(11823 bytes) I0528 18:07:24.399341 31875 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:24.400820 31875 diskrowset.cc:94] Opened CFile writer for column key[int32 NOT NULL] I0528 18:07:24.401136 31875 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:24.401492 31875 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:24.481297 31855 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 1.001, "inserted": 4590.000, "scanned": 37671.000, "updated": 220.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} W0528 18:07:24.516338 31573 thread.cc:359] Waited for 1000ms trying to join with test0 I0528 18:07:24.528787 31874 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:24.528861 31874 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:24.528903 31874 compaction.cc:551] memrowset(0 bytes) I0528 18:07:24.528942 31874 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:24.528983 31874 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:24.529754 31874 diskrowset.cc:94] Opened CFile writer for column key[int32 NOT NULL] I0528 18:07:24.530056 31874 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:24.530350 31874 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:24.639842 31875 cfile_set.cc:71] Successfully opened cfile for column key[int32 NOT NULL] in RowSet(4) I0528 18:07:24.640064 31875 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(4) I0528 18:07:24.640239 31875 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(4) I0528 18:07:24.640707 31875 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:24.643913 31875 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:24.649219 31875 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:24.649292 31875 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 5942}] I0528 18:07:24.705806 31875 delta_tracker.cc:528] Flushing 33 deltas... I0528 18:07:24.707125 31875 delta_tracker.cc:475] Flushed delta block: 1d83a76abdff44ad95388f1b52089788 I0528 18:07:24.707547 31875 delta_tracker.cc:487] Reopened delta block for read: 1d83a76abdff44ad95388f1b52089788 I0528 18:07:24.731542 31855 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 1.251, "inserted": 5712.000, "scanned": 51568.000, "updated": 250.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:24.736137 31875 tablet.cc:1207] Compaction successful on 2598 rows (84961 bytes) I0528 18:07:24.922325 31874 cfile_set.cc:71] Successfully opened cfile for column key[int32 NOT NULL] in RowSet(5) I0528 18:07:24.922557 31874 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(5) I0528 18:07:24.922740 31874 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(5) I0528 18:07:24.923262 31874 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:24.927129 31874 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:24.928243 31874 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:24.928313 31874 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 7302}] I0528 18:07:24.981755 31855 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 1.501, "inserted": 6978.000, "scanned": 65882.000, "updated": 310.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:25.137667 31874 tablet.cc:1207] Flush successful on 2575 rows (84787 bytes) I0528 18:07:25.137826 31875 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:25.137889 31875 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:25.137939 31875 compaction.cc:551] RowSet(4)(19521 bytes) I0528 18:07:25.138000 31875 compaction.cc:551] RowSet(5)(19347 bytes) I0528 18:07:25.138062 31875 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:25.142516 31874 delta_tracker.cc:528] Flushing 47 deltas... I0528 18:07:25.143939 31875 diskrowset.cc:94] Opened CFile writer for column key[int32 NOT NULL] I0528 18:07:25.144276 31874 delta_tracker.cc:475] Flushed delta block: b72b39073def4e7b836b388d42513c69 I0528 18:07:25.144321 31875 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:25.144659 31875 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:25.144688 31874 delta_tracker.cc:487] Reopened delta block for read: b72b39073def4e7b836b388d42513c69 I0528 18:07:25.231978 31855 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 1.752, "inserted": 8000.000, "scanned": 80497.000, "updated": 380.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:25.477407 31875 cfile_set.cc:71] Successfully opened cfile for column key[int32 NOT NULL] in RowSet(6) I0528 18:07:25.477581 31875 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(6) I0528 18:07:25.477713 31875 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(6) I0528 18:07:25.478067 31875 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:25.480178 31875 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:25.480366 31875 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:25.480394 31875 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 8387}] I0528 18:07:25.482182 31855 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 2.002, "inserted": 8000.000, "scanned": 86746.000, "updated": 380.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:25.540772 31875 tablet.cc:1207] Compaction successful on 5173 rows (104278 bytes) I0528 18:07:25.601052 31573 mt-tablet-test.cc:358] Sum = 31996000 I0528 18:07:25.601130 31573 mt-tablet-test.cc:356] Times for Summing int32 column: real 0.041s user 0.039s sys 0.000s I0528 18:07:25.732396 31855 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 2.252, "inserted": 8000.000, "scanned": 86746.000, "updated": 380.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:25.739344 31573 tablet-test-base.h:736] Successfully verified 8000rows [ OK ] MultiThreadedTabletTest/6.DoTestAllAtOnce (2306 ms) [ RUN ] MultiThreadedTabletTest/6.DeleteAndReinsert I0528 18:07:25.779681 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:25.780097 31878 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 0.000} I0528 18:07:25.810117 31879 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:25.810653 31879 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:25.810713 31879 compaction.cc:551] memrowset(0 bytes) I0528 18:07:25.810765 31879 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:25.810817 31879 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:25.812706 31879 diskrowset.cc:94] Opened CFile writer for column key[int32 NOT NULL] I0528 18:07:25.813117 31879 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:25.814996 31879 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:25.817965 31879 tablet.cc:1086] Flush resulted in no output rows (all input rows were GCed!) Removing all input rowsets. I0528 18:07:25.851706 31879 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:25.851799 31879 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:25.851850 31879 compaction.cc:551] memrowset(0 bytes) I0528 18:07:25.851903 31879 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:25.851938 31879 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:25.853216 31879 diskrowset.cc:94] Opened CFile writer for column key[int32 NOT NULL] I0528 18:07:25.853644 31879 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:25.854104 31879 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] W0528 18:07:25.859148 31879 compaction.cc:654] Found REINSERT REDO truncating row history for Row: (int32 key=-8, uint32 val=8, uint32 update_count=1) Redo Mutations: [@12(SET update_count=1), @21(DELETE), @25(REINSERT (int32 key=-8, uint32 val=8, uint32 update_count=1)), @26(SET update_count=3), @30(SET update_count=4), @34(SET update_count=5), @46(SET update_count=6), @61(SET update_count=7), @76(SET update_count=8), @79(SET update_count=9), @82(DELETE), @100(REINSERT (int32 key=-8, uint32 val=8, uint32 update_count=2)), @110(DELETE), @135(REINSERT (int32 key=-8, uint32 val=8, uint32 update_count=3)), @139(SET update_count=12), @142(SET update_count=13), @144(DELETE), @151(REINSERT (int32 key=-8, uint32 val=8, uint32 update_count=4)), @154(SET update_count=15), @164(SET update_count=16), @169(DELETE), @191(REINSERT (int32 key=-8, uint32 val=8, uint32 update_count=5)), @218(DELETE), @226(REINSERT (int32 key=-8, uint32 val=8, uint32 update_count=6)), @275(SET update_count=18), @281(SET update_count=19), @288(SET update_count=20), @292(DELETE), @309(REINSERT (int32 key=-8, uint32 val=8, uint32 update_count=7)), @317(SET update_count=24), @329(DELETE)] Undo Mutations: [@9(DELETE)] Note: this warning will appear only for the first truncated row W0528 18:07:25.866220 31879 compaction.cc:764] Total 56 rows lost some history due to REINSERT after DELETE I0528 18:07:25.869807 31879 cfile_set.cc:71] Successfully opened cfile for column key[int32 NOT NULL] in RowSet(1) I0528 18:07:25.870048 31879 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:25.870214 31879 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:25.870774 31879 delta_tracker.cc:214] Successfully opened delta file 0 I0528 18:07:25.872268 31879 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:25.876828 31879 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:25.879019 31879 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:25.879530 31879 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 593}] I0528 18:07:25.885865 31879 delta_tracker.cc:528] Flushing 12 deltas... I0528 18:07:25.886823 31879 delta_tracker.cc:475] Flushed delta block: e639a67841e746759f4922e3e4696618 I0528 18:07:25.887248 31879 delta_tracker.cc:487] Reopened delta block for read: e639a67841e746759f4922e3e4696618 I0528 18:07:25.901525 31879 tablet.cc:1207] Flush successful on 10 rows (65791 bytes) I0528 18:07:26.030318 31878 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 0.250} I0528 18:07:26.280594 31878 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 0.501} I0528 18:07:26.530885 31878 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 0.751} I0528 18:07:26.781227 31878 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 1.001} W0528 18:07:26.925642 31573 thread.cc:359] Waited for 1000ms trying to join with test0 I0528 18:07:27.031550 31878 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 1.251} I0528 18:07:27.281823 31878 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/6", "time": 1.502} [ OK ] MultiThreadedTabletTest/6.DeleteAndReinsert (1647 ms) [----------] 2 tests from MultiThreadedTabletTest/6 (3953 ms total) [----------] 2 tests from MultiThreadedTabletTest/7, where TypeParam = kudu::tablet::IntKeyTestSetup<(kudu::DataType)6> [ RUN ] MultiThreadedTabletTest/7.DoTestAllAtOnce I0528 18:07:27.432874 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:27.433392 31901 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/7", "time": 0.000} I0528 18:07:27.451436 31923 mt-tablet-test.cc:88] Update thread using schema: Schema [key[uint64 NOT NULL], val[uint32 NOT NULL], update_count[uint32 NOT NULL]] I0528 18:07:27.466816 31920 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:27.466917 31920 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:27.467651 31920 compaction.cc:551] memrowset(0 bytes) I0528 18:07:27.467700 31920 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:27.467749 31920 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:27.469075 31920 diskrowset.cc:94] Opened CFile writer for column key[uint64 NOT NULL] I0528 18:07:27.469774 31920 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:27.470173 31920 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:27.495127 31920 cfile_set.cc:71] Successfully opened cfile for column key[uint64 NOT NULL] in RowSet(0) I0528 18:07:27.495297 31920 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(0) I0528 18:07:27.495445 31920 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(0) I0528 18:07:27.495851 31920 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:27.499888 31920 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:27.500957 31920 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:27.501010 31920 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 356}] I0528 18:07:27.519891 31920 delta_tracker.cc:528] Flushing 9 deltas... I0528 18:07:27.523660 31920 delta_tracker.cc:475] Flushed delta block: fc7d3da89850473c93a947c4ab857b26 I0528 18:07:27.525243 31920 delta_tracker.cc:487] Reopened delta block for read: fc7d3da89850473c93a947c4ab857b26 I0528 18:07:27.546861 31920 tablet.cc:1207] Flush successful on 172 rows (67683 bytes) I0528 18:07:27.550392 31920 delta_tracker.cc:528] Flushing 3 deltas... I0528 18:07:27.551378 31920 delta_tracker.cc:475] Flushed delta block: 1332fcf57d0f448e9ad18a511ae31da5 I0528 18:07:27.552680 31920 delta_tracker.cc:487] Reopened delta block for read: 1332fcf57d0f448e9ad18a511ae31da5 I0528 18:07:27.607648 31920 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:27.607736 31920 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:27.607789 31920 compaction.cc:551] memrowset(0 bytes) I0528 18:07:27.607841 31920 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:27.607890 31920 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:27.609855 31920 diskrowset.cc:94] Opened CFile writer for column key[uint64 NOT NULL] I0528 18:07:27.613894 31920 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:27.614392 31920 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:27.683612 31901 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/7", "time": 0.250, "inserted": 1122.000, "scanned": 3624.000, "updated": 40.000, "num_rowsets": 0.000, "memrowset_kb": 1536.000} I0528 18:07:27.783493 31920 cfile_set.cc:71] Successfully opened cfile for column key[uint64 NOT NULL] in RowSet(1) I0528 18:07:27.791437 31920 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:27.794714 31920 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:27.795306 31920 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:27.798580 31920 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:27.801337 31920 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:27.802117 31920 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2376}] I0528 18:07:27.877288 31920 delta_tracker.cc:528] Flushing 20 deltas... I0528 18:07:27.884132 31920 delta_tracker.cc:475] Flushed delta block: aa6a4ca9df924639b5e9e3c2148067e7 I0528 18:07:27.884574 31920 delta_tracker.cc:487] Reopened delta block for read: aa6a4ca9df924639b5e9e3c2148067e7 I0528 18:07:27.902350 31920 tablet.cc:1207] Flush successful on 873 rows (75707 bytes) I0528 18:07:27.911324 31920 delta_tracker.cc:528] Flushing 19 deltas... I0528 18:07:27.914472 31920 delta_tracker.cc:475] Flushed delta block: 950e227b9d6f442085f88678c034ad81 I0528 18:07:27.915011 31920 delta_tracker.cc:487] Reopened delta block for read: 950e227b9d6f442085f88678c034ad81 I0528 18:07:27.933814 31901 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/7", "time": 0.500, "inserted": 2754.000, "scanned": 12306.000, "updated": 100.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:27.968948 31921 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:27.969025 31921 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:27.969072 31921 compaction.cc:551] RowSet(0)(2247 bytes) I0528 18:07:27.969135 31921 compaction.cc:551] RowSet(1)(10271 bytes) I0528 18:07:27.969197 31921 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:27.971818 31921 diskrowset.cc:94] Opened CFile writer for column key[uint64 NOT NULL] I0528 18:07:27.972115 31921 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:27.972561 31921 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:28.006891 31920 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:28.006979 31920 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:28.007030 31920 compaction.cc:551] memrowset(0 bytes) I0528 18:07:28.007082 31920 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:28.007133 31920 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:28.012363 31920 diskrowset.cc:94] Opened CFile writer for column key[uint64 NOT NULL] I0528 18:07:28.012919 31920 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:28.013561 31920 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:28.118391 31921 cfile_set.cc:71] Successfully opened cfile for column key[uint64 NOT NULL] in RowSet(2) I0528 18:07:28.118677 31921 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(2) I0528 18:07:28.120230 31921 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(2) I0528 18:07:28.121248 31921 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:28.130132 31921 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:28.132279 31921 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:28.132371 31921 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 4658}] I0528 18:07:28.184059 31901 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/7", "time": 0.751, "inserted": 4366.000, "scanned": 23657.000, "updated": 150.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:28.200168 31921 tablet.cc:1207] Compaction successful on 1045 rows (77657 bytes) I0528 18:07:28.434301 31901 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/7", "time": 1.001, "inserted": 5896.000, "scanned": 34016.000, "updated": 200.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} W0528 18:07:28.451279 31573 thread.cc:359] Waited for 1000ms trying to join with test0 I0528 18:07:28.512459 31920 cfile_set.cc:71] Successfully opened cfile for column key[uint64 NOT NULL] in RowSet(3) I0528 18:07:28.512716 31920 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(3) I0528 18:07:28.512888 31920 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(3) I0528 18:07:28.513375 31920 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:28.516649 31920 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:28.521386 31920 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:28.521483 31920 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 7010}] I0528 18:07:28.684543 31901 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/7", "time": 1.251, "inserted": 7550.000, "scanned": 45604.000, "updated": 250.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:28.758085 31920 delta_tracker.cc:528] Flushing 81 deltas... I0528 18:07:28.760547 31920 delta_tracker.cc:475] Flushed delta block: 4b62f875d78642ac8b3088fa45e096f0 I0528 18:07:28.763870 31920 delta_tracker.cc:487] Reopened delta block for read: 4b62f875d78642ac8b3088fa45e096f0 I0528 18:07:28.788147 31920 tablet.cc:1207] Flush successful on 2776 rows (97418 bytes) I0528 18:07:28.791715 31920 delta_tracker.cc:528] Flushing 83 deltas... I0528 18:07:28.793087 31920 delta_tracker.cc:475] Flushed delta block: 19366cd960c64af896c7eb2d5ac20ca8 I0528 18:07:28.793362 31920 delta_tracker.cc:487] Reopened delta block for read: 19366cd960c64af896c7eb2d5ac20ca8 I0528 18:07:28.907750 31573 mt-tablet-test.cc:358] Sum = 31996000 I0528 18:07:28.907822 31573 mt-tablet-test.cc:356] Times for Summing int32 column: real 0.063s user 0.064s sys 0.000s I0528 18:07:28.934805 31901 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/7", "time": 1.501, "inserted": 8000.000, "scanned": 53500.000, "updated": 280.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:29.113996 31573 tablet-test-base.h:736] Successfully verified 8000rows [ OK ] MultiThreadedTabletTest/7.DoTestAllAtOnce (1732 ms) [ RUN ] MultiThreadedTabletTest/7.DeleteAndReinsert I0528 18:07:29.161967 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:29.162482 31925 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/7", "time": 0.000} I0528 18:07:29.174873 31926 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:29.174999 31926 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:29.175065 31926 compaction.cc:551] memrowset(0 bytes) I0528 18:07:29.175122 31926 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:29.175163 31926 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:29.175883 31926 diskrowset.cc:94] Opened CFile writer for column key[uint64 NOT NULL] I0528 18:07:29.176270 31926 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:29.177364 31926 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:29.182945 31926 tablet.cc:1086] Flush resulted in no output rows (all input rows were GCed!) Removing all input rowsets. I0528 18:07:29.214057 31926 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:29.214203 31926 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:29.214257 31926 compaction.cc:551] memrowset(0 bytes) I0528 18:07:29.214294 31926 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:29.214332 31926 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:29.221137 31926 diskrowset.cc:94] Opened CFile writer for column key[uint64 NOT NULL] I0528 18:07:29.221506 31926 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:29.221900 31926 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] W0528 18:07:29.225247 31926 compaction.cc:654] Found REINSERT REDO truncating row history for Row: (uint64 key=0, uint32 val=0, uint32 update_count=1) Redo Mutations: [@10(SET update_count=0), @11(SET update_count=1), @15(DELETE), @20(REINSERT (uint64 key=0, uint32 val=0, uint32 update_count=1)), @27(SET update_count=3), @39(DELETE), @69(REINSERT (uint64 key=0, uint32 val=0, uint32 update_count=2)), @83(SET update_count=7), @87(SET update_count=8), @95(SET update_count=9), @99(SET update_count=10), @106(SET update_count=11), @110(SET update_count=12), @113(DELETE), @121(REINSERT (uint64 key=0, uint32 val=0, uint32 update_count=3)), @125(SET update_count=14), @128(DELETE), @130(REINSERT (uint64 key=0, uint32 val=0, uint32 update_count=4)), @135(DELETE), @175(REINSERT (uint64 key=0, uint32 val=0, uint32 update_count=5)), @209(SET update_count=17), @223(DELETE), @238(REINSERT (uint64 key=0, uint32 val=0, uint32 update_count=6)), @246(DELETE)] Undo Mutations: [@4(DELETE)] Note: this warning will appear only for the first truncated row W0528 18:07:29.230180 31926 compaction.cc:764] Total 70 rows lost some history due to REINSERT after DELETE I0528 18:07:29.236687 31926 cfile_set.cc:71] Successfully opened cfile for column key[uint64 NOT NULL] in RowSet(1) I0528 18:07:29.236934 31926 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:29.237123 31926 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:29.237835 31926 delta_tracker.cc:214] Successfully opened delta file 0 I0528 18:07:29.238518 31926 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:29.242810 31926 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:29.246011 31926 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:29.246089 31926 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 553}] I0528 18:07:29.251991 31926 delta_tracker.cc:528] Flushing 8 deltas... I0528 18:07:29.253053 31926 delta_tracker.cc:475] Flushed delta block: a775ddc30031471e80a18fb45f3ca891 I0528 18:07:29.253743 31926 delta_tracker.cc:487] Reopened delta block for read: a775ddc30031471e80a18fb45f3ca891 I0528 18:07:29.271497 31926 tablet.cc:1207] Flush successful on 10 rows (65839 bytes) I0528 18:07:29.303148 31926 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:29.303251 31926 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:29.303385 31926 compaction.cc:551] memrowset(0 bytes) I0528 18:07:29.303453 31926 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:29.303511 31926 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:29.304435 31926 diskrowset.cc:94] Opened CFile writer for column key[uint64 NOT NULL] I0528 18:07:29.304889 31926 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:29.305243 31926 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] W0528 18:07:29.308281 31926 compaction.cc:654] Found REINSERT REDO truncating row history for Row: (uint64 key=0, uint32 val=0, uint32 update_count=8) Redo Mutations: [@320(SET update_count=19), @334(SET update_count=20), @347(DELETE), @363(REINSERT (uint64 key=0, uint32 val=0, uint32 update_count=8)), @369(SET update_count=22), @371(SET update_count=23), @375(DELETE), @384(REINSERT (uint64 key=0, uint32 val=0, uint32 update_count=9)), @425(SET update_count=24), @429(SET update_count=25), @433(DELETE), @444(REINSERT (uint64 key=0, uint32 val=0, uint32 update_count=10)), @477(DELETE), @495(REINSERT (uint64 key=0, uint32 val=0, uint32 update_count=11)), @501(SET update_count=28), @507(SET update_count=29), @513(SET update_count=30), @519(DELETE), @541(REINSERT (uint64 key=0, uint32 val=0, uint32 update_count=12)), @546(SET update_count=34), @554(SET update_count=35), @597(SET update_count=36), @604(DELETE), @630(REINSERT (uint64 key=0, uint32 val=0, uint32 update_count=13)), @653(SET update_count=38), @658(SET update_count=39), @665(DELETE), @692(REINSERT (uint64 key=0, uint32 val=0, uint32 update_count=14)), @742(SET update_count=41), @746(DELETE), @756(REINSERT (uint64 key=0, uint32 val=0, uint32 update_count=15)), @782(SET update_count=43), @801(DELETE)] Undo Mutations: [@307(DELETE)] Note: this warning will appear only for the first truncated row W0528 18:07:29.321655 31926 compaction.cc:764] Total 114 rows lost some history due to REINSERT after DELETE I0528 18:07:29.325793 31926 cfile_set.cc:71] Successfully opened cfile for column key[uint64 NOT NULL] in RowSet(2) I0528 18:07:29.326380 31926 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(2) I0528 18:07:29.326616 31926 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(2) I0528 18:07:29.327070 31926 delta_tracker.cc:214] Successfully opened delta file 0 I0528 18:07:29.327369 31926 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:29.332708 31926 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:29.336594 31926 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:29.336673 31926 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 1018}] I0528 18:07:29.343757 31926 delta_tracker.cc:528] Flushing 6 deltas... I0528 18:07:29.344535 31926 delta_tracker.cc:475] Flushed delta block: 854c1a28457b47e6b0bc3c7f4fef4c49 I0528 18:07:29.344969 31926 delta_tracker.cc:487] Reopened delta block for read: 854c1a28457b47e6b0bc3c7f4fef4c49 I0528 18:07:29.367686 31926 tablet.cc:1207] Flush successful on 10 rows (65839 bytes) I0528 18:07:29.412680 31925 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/7", "time": 0.250} I0528 18:07:29.662925 31925 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/7", "time": 0.500} I0528 18:07:29.913189 31925 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/7", "time": 0.751} [ OK ] MultiThreadedTabletTest/7.DeleteAndReinsert (934 ms) [----------] 2 tests from MultiThreadedTabletTest/7 (2666 ms total) [----------] 2 tests from MultiThreadedTabletTest/8, where TypeParam = kudu::tablet::IntKeyTestSetup<(kudu::DataType)7> [ RUN ] MultiThreadedTabletTest/8.DoTestAllAtOnce I0528 18:07:30.106313 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:30.107040 31948 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 0.000} I0528 18:07:30.135817 31970 mt-tablet-test.cc:88] Update thread using schema: Schema [key[int64 NOT NULL], val[uint32 NOT NULL], update_count[uint32 NOT NULL]] I0528 18:07:30.153295 31967 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:30.153375 31967 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:30.153415 31967 compaction.cc:551] memrowset(0 bytes) I0528 18:07:30.153540 31967 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:30.153600 31967 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:30.154646 31967 diskrowset.cc:94] Opened CFile writer for column key[int64 NOT NULL] I0528 18:07:30.155145 31967 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:30.155864 31967 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:30.192596 31967 cfile_set.cc:71] Successfully opened cfile for column key[int64 NOT NULL] in RowSet(0) I0528 18:07:30.192852 31967 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(0) I0528 18:07:30.193060 31967 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(0) I0528 18:07:30.193660 31967 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:30.197794 31967 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:30.200263 31967 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:30.200325 31967 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 407}] I0528 18:07:30.288177 31967 delta_tracker.cc:528] Flushing 10 deltas... I0528 18:07:30.288939 31967 delta_tracker.cc:475] Flushed delta block: 3988754d88d1461b842905135e9d55b7 I0528 18:07:30.289239 31967 delta_tracker.cc:487] Reopened delta block for read: 3988754d88d1461b842905135e9d55b7 I0528 18:07:30.310484 31967 tablet.cc:1207] Flush successful on 312 rows (69236 bytes) I0528 18:07:30.315292 31967 delta_tracker.cc:528] Flushing 7 deltas... I0528 18:07:30.316356 31967 delta_tracker.cc:475] Flushed delta block: 03276d4dd1ac4729b0f8f015112a4e65 I0528 18:07:30.316867 31967 delta_tracker.cc:487] Reopened delta block for read: 03276d4dd1ac4729b0f8f015112a4e65 I0528 18:07:30.357316 31948 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 0.250, "inserted": 714.000, "scanned": 4922.000, "updated": 20.000, "num_rowsets": 0.000, "memrowset_kb": 1536.000} ================== WARNING: ThreadSanitizer: data race (pid=31573) Write of size 8 at 0x7d540000fd48 by thread T39 (mutexes: write M887319): #0 void std::swap(kudu::tablet::MemRowSet*&, kudu::tablet::MemRowSet*&) /usr/lib/gcc/x86_64-linux-gnu/4.8/../../../../include/c++/4.8/bits/move.h:177 (mt-tablet-test+0x00000041a4ea) #1 std::tr1::__shared_ptr::swap(std::tr1::__shared_ptr&) /usr/lib/gcc/x86_64-linux-gnu/4.8/../../../../include/c++/4.8/tr1/shared_ptr.h:699 (mt-tablet-test+0x00000041a490) #2 void std::tr1::__shared_ptr::reset(kudu::tablet::MemRowSet*) /usr/lib/gcc/x86_64-linux-gnu/4.8/../../../../include/c++/4.8/tr1/shared_ptr.h:653 (mt-tablet-test+0x000000405385) #3 kudu::tablet::Tablet::ReplaceMemRowSetUnlocked(kudu::Schema const&, kudu::tablet::RowSetsInCompaction*, std::tr1::shared_ptr*) /home/mpercy/src/kudu/src/tablet/tablet.cc:651 (mt-tablet-test+0x0000003fdd9d) #4 kudu::tablet::Tablet::FlushUnlocked() /home/mpercy/src/kudu/src/tablet/tablet.cc:640 (mt-tablet-test+0x0000003fdc02) #5 kudu::tablet::Tablet::Flush() /home/mpercy/src/kudu/src/tablet/tablet.cc:625 (mt-tablet-test+0x0000003fdb54) #6 kudu::tablet::MultiThreadedTabletTest >::FlushThread(int) /home/mpercy/src/kudu/src/tablet/mt-tablet-test.cc:238 (mt-tablet-test+0x0000003b53fe) #7 boost::_mfi::mf1 >, int>::operator()(kudu::tablet::MultiThreadedTabletTest >*, int) const /usr/include/boost/bind/mem_fn_template.hpp:165 (mt-tablet-test+0x0000003b6e74) #8 void boost::_bi::list2 >*>, boost::_bi::value >::operator() >, int>, boost::_bi::list0>(boost::_bi::type, boost::_mfi::mf1 >, int>&, boost::_bi::list0&, int) /usr/include/boost/bind/bind.hpp:313 (mt-tablet-test+0x0000003b6dda) #9 boost::_bi::bind_t >, int>, boost::_bi::list2 >*>, boost::_bi::value > >::operator()() /usr/include/boost/bind/bind_template.hpp:20 (mt-tablet-test+0x0000003b6d63) #10 boost::detail::function::void_function_obj_invoker0 >, int>, boost::_bi::list2 >*>, boost::_bi::value > >, void>::invoke(boost::detail::function::function_buffer&) /usr/include/boost/function/function_template.hpp:153 (mt-tablet-test+0x0000003b6b61) #11 boost::function0::operator()() const /usr/include/boost/function/function_template.hpp:766 (mt-tablet-test+0x0000005b89c1) #12 kudu::Thread::SuperviseThread(boost::function, long*) /home/mpercy/src/kudu/src/util/thread.cc:462 (mt-tablet-test+0x0000005b6b7a) #13 boost::_mfi::mf2, long*>::operator()(kudu::Thread*, boost::function, long*) const /usr/include/boost/bind/mem_fn_template.hpp:280 (mt-tablet-test+0x0000005ba470) #14 void boost::_bi::list3, boost::_bi::value >, boost::_bi::value >::operator(), long*>, boost::_bi::list0>(boost::_bi::type, boost::_mfi::mf2, long*>&, boost::_bi::list0&, int) /usr/include/boost/bind/bind.hpp:392 (mt-tablet-test+0x0000005ba38f) #15 boost::_bi::bind_t, long*>, boost::_bi::list3, boost::_bi::value >, boost::_bi::value > >::operator()() /usr/include/boost/bind/bind_template.hpp:20 (mt-tablet-test+0x0000005ba2f3) #16 boost::detail::thread_data, long*>, boost::_bi::list3, boost::_bi::value >, boost::_bi::value > > >::run() /usr/include/boost/thread/detail/thread.hpp:117 (mt-tablet-test+0x0000005b95a0) #17 :0 (libboost_thread.so.1.54.0+0x00000000ba49) Previous read of size 8 at 0x7d540000fd48 by thread T6: #0 std::tr1::__shared_ptr::operator->() const /usr/lib/gcc/x86_64-linux-gnu/4.8/../../../../include/c++/4.8/tr1/shared_ptr.h:673 (mt-tablet-test+0x0000004069b9) #1 kudu::tablet::Tablet::MemRowSetSize() const /home/mpercy/src/kudu/src/tablet/tablet.cc:1330 (mt-tablet-test+0x000000402c20) #2 kudu::tablet::MultiThreadedTabletTest >::CollectStatisticsThread(int) /home/mpercy/src/kudu/src/tablet/mt-tablet-test.cc:306 (mt-tablet-test+0x0000003d90b9) #3 boost::_mfi::mf1 >, int>::operator()(kudu::tablet::MultiThreadedTabletTest >*, int) const /usr/include/boost/bind/mem_fn_template.hpp:165 (mt-tablet-test+0x0000003b6e74) #4 void boost::_bi::list2 >*>, boost::_bi::value >::operator() >, int>, boost::_bi::list0>(boost::_bi::type, boost::_mfi::mf1 >, int>&, boost::_bi::list0&, int) /usr/include/boost/bind/bind.hpp:313 (mt-tablet-test+0x0000003b6dda) #5 boost::_bi::bind_t >, int>, boost::_bi::list2 >*>, boost::_bi::value > >::operator()() /usr/include/boost/bind/bind_template.hpp:20 (mt-tablet-test+0x0000003b6d63) #6 boost::detail::function::void_function_obj_invoker0 >, int>, boost::_bi::list2 >*>, boost::_bi::value > >, void>::invoke(boost::detail::function::function_buffer&) /usr/include/boost/function/function_template.hpp:153 (mt-tablet-test+0x0000003b6b61) #7 boost::function0::operator()() const /usr/include/boost/function/function_template.hpp:766 (mt-tablet-test+0x0000005b89c1) #8 kudu::Thread::SuperviseThread(boost::function, long*) /home/mpercy/src/kudu/src/util/thread.cc:462 (mt-tablet-test+0x0000005b6b7a) #9 boost::_mfi::mf2, long*>::operator()(kudu::Thread*, boost::function, long*) const /usr/include/boost/bind/mem_fn_template.hpp:280 (mt-tablet-test+0x0000005ba470) #10 void boost::_bi::list3, boost::_bi::value >, boost::_bi::value >::operator(), long*>, boost::_bi::list0>(boost::_bi::type, boost::_mfi::mf2, long*>&, boost::_bi::list0&, int) /usr/include/boost/bind/bind.hpp:392 (mt-tablet-test+0x0000005ba38f) #11 boost::_bi::bind_t, long*>, boost::_bi::list3, boost::_bi::value >, boost::_bi::value > >::operator()() /usr/include/boost/bind/bind_template.hpp:20 (mt-tablet-test+0x0000005ba2f3) #12 boost::detail::thread_data, long*>, boost::_bi::list3, boost::_bi::value >, boost::_bi::value > > >::run() /usr/include/boost/thread/detail/thread.hpp:117 (mt-tablet-test+0x0000005b95a0) #13 :0 (libboost_thread.so.1.54.0+0x00000000ba49) #14 kudu::tablet::TabletTestBase >::InsertTestRows(unsigned long, unsigned long, unsigned int, kudu::TimeSeries*) /home/mpercy/src/kudu/src/tablet/tablet-test-base.h:638 (mt-tablet-test+0x0000003b8d4a) #15 kudu::tablet::MultiThreadedTabletTest >::InsertThread(int) /home/mpercy/src/kudu/src/tablet/mt-tablet-test.cc:69 (mt-tablet-test+0x0000003dc903) #16 boost::_mfi::mf1 >, int>::operator()(kudu::tablet::MultiThreadedTabletTest >*, int) const /usr/include/boost/bind/mem_fn_template.hpp:165 (mt-tablet-test+0x0000003b9924) #17 void boost::_bi::list2 >*>, boost::_bi::value >::operator() >, int>, boost::_bi::list0>(boost::_bi::type, boost::_mfi::mf1 >, int>&, boost::_bi::list0&, int) /usr/include/boost/bind/bind.hpp:313 (mt-tablet-test+0x0000003b988a) #18 boost::_bi::bind_t >, int>, boost::_bi::list2 >*>, boost::_bi::value > >::operator()() /usr/include/boost/bind/bind_template.hpp:20 (mt-tablet-test+0x0000003b9813) #19 boost::detail::function::void_function_obj_invoker0 >, int>, boost::_bi::list2 >*>, boost::_bi::value > >, void>::invoke(boost::detail::function::function_buffer&) /usr/include/boost/function/function_template.hpp:153 (mt-tablet-test+0x0000003b9611) #20 boost::function0::operator()() const /usr/include/boost/function/function_template.hpp:766 (mt-tablet-test+0x0000005b89c1) #21 kudu::Thread::SuperviseThread(boost::function, long*) /home/mpercy/src/kudu/src/util/thread.cc:462 (mt-tablet-test+0x0000005b6b7a) #22 boost::_mfi::mf2, long*>::operator()(kudu::Thread*, boost::function, long*) const /usr/include/boost/bind/mem_fn_template.hpp:280 (mt-tablet-test+0x0000005ba470) #23 void boost::_bi::list3, boost::_bi::value >, boost::_bi::value >::operator(), long*>, boost::_bi::list0>(boost::_bi::type, boost::_mfi::mf2, long*>&, boost::_bi::list0&, int) /usr/include/boost/bind/bind.hpp:392 (mt-tablet-test+0x0000005ba38f) #24 boost::_bi::bind_t, long*>, boost::_bi::list3, boost::_bi::value >, boost::_bi::value > >::operator()() /usr/include/boost/bind/bind_template.hpp:20 (mt-tablet-test+0x0000005ba2f3) #25 boost::detail::thread_data, long*>, boost::_bi::list3, boost::_bi::value >, boost::_bi::value > > >::run() /usr/include/boost/thread/detail/thread.hpp:117 (mt-tablet-test+0x0000005b95a0) #26 :0 (libboost_thread.so.1.54.0+0x00000000ba49) As if synchronized via sleep: #0 nanosleep /home/ben/development/llvm/3.4/final/llvm.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:253 (mt-tablet-test+0x00000033827d) #1 boost::detail::yield(unsigned int) /usr/include/boost/smart_ptr/detail/yield_k.hpp:123 (mt-tablet-test+0x0000003a032a) #2 kudu::rw_semaphore::WaitPendingReaders() /home/mpercy/src/kudu/src/util/rw_semaphore.h:130 (mt-tablet-test+0x00000041b7d7) #3 kudu::rw_semaphore::lock() /home/mpercy/src/kudu/src/util/rw_semaphore.h:100 (mt-tablet-test+0x00000041b717) #4 boost::lock_guard::lock_guard(kudu::rw_semaphore&) /usr/include/boost/thread/lock_guard.hpp:38 (mt-tablet-test+0x000000404a68) #5 kudu::tablet::Tablet::FlushUnlocked() /home/mpercy/src/kudu/src/tablet/tablet.cc:638 (mt-tablet-test+0x0000003fdbd6) #6 kudu::tablet::Tablet::Flush() /home/mpercy/src/kudu/src/tablet/tablet.cc:625 (mt-tablet-test+0x0000003fdb54) #7 kudu::tablet::MultiThreadedTabletTest >::FlushThread(int) /home/mpercy/src/kudu/src/tablet/mt-tablet-test.cc:238 (mt-tablet-test+0x0000003b53fe) #8 boost::_mfi::mf1 >, int>::operator()(kudu::tablet::MultiThreadedTabletTest >*, int) const /usr/include/boost/bind/mem_fn_template.hpp:165 (mt-tablet-test+0x0000003b6e74) #9 void boost::_bi::list2 >*>, boost::_bi::value >::operator() >, int>, boost::_bi::list0>(boost::_bi::type, boost::_mfi::mf1 >, int>&, boost::_bi::list0&, int) /usr/include/boost/bind/bind.hpp:313 (mt-tablet-test+0x0000003b6dda) #10 boost::_bi::bind_t >, int>, boost::_bi::list2 >*>, boost::_bi::value > >::operator()() /usr/include/boost/bind/bind_template.hpp:20 (mt-tablet-test+0x0000003b6d63) #11 boost::detail::function::void_function_obj_invoker0 >, int>, boost::_bi::list2 >*>, boost::_bi::value > >, void>::invoke(boost::detail::function::function_buffer&) /usr/include/boost/function/function_template.hpp:153 (mt-tablet-test+0x0000003b6b61) #12 boost::function0::operator()() const /usr/include/boost/function/function_template.hpp:766 (mt-tablet-test+0x0000005b89c1) #13 kudu::Thread::SuperviseThread(boost::function, long*) /home/mpercy/src/kudu/src/util/thread.cc:462 (mt-tablet-test+0x0000005b6b7a) #14 boost::_mfi::mf2, long*>::operator()(kudu::Thread*, boost::function, long*) const /usr/include/boost/bind/mem_fn_template.hpp:280 (mt-tablet-test+0x0000005ba470) #15 void boost::_bi::list3, boost::_bi::value >, boost::_bi::value >::operator(), long*>, boost::_bi::list0>(boost::_bi::type, boost::_mfi::mf2, long*>&, boost::_bi::list0&, int) /usr/include/boost/bind/bind.hpp:392 (mt-tablet-test+0x0000005ba38f) #16 boost::_bi::bind_t, long*>, boost::_bi::list3, boost::_bi::value >, boost::_bi::value > >::operator()() /usr/include/boost/bind/bind_template.hpp:20 (mt-tablet-test+0x0000005ba2f3) #17 boost::detail::thread_data, long*>, boost::_bi::list3, boost::_bi::value >, boost::_bi::value > > >::run() /usr/include/boost/thread/detail/thread.hpp:117 (mt-tablet-test+0x0000005b95a0) #18 :0 (libboost_thread.so.1.54.0+0x00000000ba49) Location is heap block of size 568 at 0x7d540000fc80 allocated by main thread: #0 operator new(unsigned long) /home/ben/development/llvm/3.4/final/llvm.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:560 (mt-tablet-test+0x00000033a3f9) #1 kudu::tablet::KuduTabletTest::SetUpTestTablet(std::string const&) /home/mpercy/src/kudu/src/tablet/tablet-test-util.h:61 (mt-tablet-test+0x0000003accd6) #2 kudu::tablet::KuduTabletTest::SetUp() /home/mpercy/src/kudu/src/tablet/tablet-test-util.h:35 (mt-tablet-test+0x0000003ac4cc) #3 kudu::tablet::MultiThreadedTabletTest >::SetUp() /home/mpercy/src/kudu/src/tablet/mt-tablet-test.cc:46 (mt-tablet-test+0x0000003b4db9) #4 void testing::internal::HandleSehExceptionsInMethodIfSupported(testing::Test*, void (testing::Test::*)(), char const*) :0 (mt-tablet-test+0x00000067b580) #5 __libc_start_main /build/buildd/eglibc-2.17/csu/libc-start.c:260 (libc.so.6+0x000000021de4) Mutex M887319 created at: #0 pthread_mutex_init /home/ben/development/llvm/3.4/final/llvm.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:925 (mt-tablet-test+0x00000033e73b) #1 boost::mutex::mutex() /usr/include/boost/thread/pthread/mutex.hpp:100 (mt-tablet-test+0x0000003b023e) #2 kudu::tablet::Tablet::Tablet(gscoped_ptr >, scoped_refptr const&, kudu::MetricContext const*, kudu::log::OpIdAnchorRegistry*) /home/mpercy/src/kudu/src/tablet/tablet.cc:114 (mt-tablet-test+0x0000003f84c8) #3 kudu::tablet::KuduTabletTest::SetUpTestTablet(std::string const&) /home/mpercy/src/kudu/src/tablet/tablet-test-util.h:61 (mt-tablet-test+0x0000003acd2f) #4 kudu::tablet::KuduTabletTest::SetUp() /home/mpercy/src/kudu/src/tablet/tablet-test-util.h:35 (mt-tablet-test+0x0000003ac4cc) #5 kudu::tablet::MultiThreadedTabletTest >::SetUp() /home/mpercy/src/kudu/src/tablet/mt-tablet-test.cc:46 (mt-tablet-test+0x0000003b4db9) #6 void testing::internal::HandleSehExceptionsInMethodIfSupported(testing::Test*, void (testing::Test::*)(), char const*) :0 (mt-tablet-test+0x00000067b580) #7 __libc_start_main /build/buildd/eglibc-2.17/csu/libc-start.c:260 (libc.so.6+0x000000021de4) Thread T39 'test0-31967' (tid=31967, running) created by main thread at: #0 pthread_create /home/ben/development/llvm/3.4/final/llvm.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:877 (mt-tablet-test+0x00000033e0ab) #1 :0 (libboost_thread.so.1.54.0+0x00000000b3b8) #2 boost::thread::thread, long*), kudu::Thread*, boost::function, long*>(void (kudu::Thread::*)(boost::function, long*), kudu::Thread*, boost::function, long*) /usr/include/boost/thread/detail/thread.hpp:404 (mt-tablet-test+0x0000005b87a3) #3 kudu::Thread::StartThread(std::string const&, std::string const&, boost::function const&, scoped_refptr*) /home/mpercy/src/kudu/src/util/thread.cc:401 (mt-tablet-test+0x0000005b665e) #4 kudu::Status kudu::Thread::Create >::*)(int), kudu::tablet::MultiThreadedTabletTest >*, int>(std::string const&, std::string const&, void (kudu::tablet::MultiThreadedTabletTest >::* const&)(int), kudu::tablet::MultiThreadedTabletTest >* const&, int const&, scoped_refptr*) /home/mpercy/src/kudu/src/util/thread.h:129 (mt-tablet-test+0x0000003b6710) #5 void kudu::tablet::MultiThreadedTabletTest >::StartThreads >::*)(int)>(int, void (kudu::tablet::MultiThreadedTabletTest >::* const&)(int)) /home/mpercy/src/kudu/src/tablet/mt-tablet-test.cc:317 (mt-tablet-test+0x0000003b5196) #6 kudu::tablet::MultiThreadedTabletTest_DoTestAllAtOnce_Test >::TestBody() /home/mpercy/src/kudu/src/tablet/mt-tablet-test.cc:351 (mt-tablet-test+0x0000003d8d04) #7 void testing::internal::HandleSehExceptionsInMethodIfSupported(testing::Test*, void (testing::Test::*)(), char const*) :0 (mt-tablet-test+0x00000067b580) #8 __libc_start_main /build/buildd/eglibc-2.17/csu/libc-start.c:260 (libc.so.6+0x000000021de4) Thread T6 'test0-31949' (tid=31949, running) created by main thread at: #0 pthread_create /home/ben/development/llvm/3.4/final/llvm.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:877 (mt-tablet-test+0x00000033e0ab) #1 :0 (libboost_thread.so.1.54.0+0x00000000b3b8) #2 boost::thread::thread, long*), kudu::Thread*, boost::function, long*>(void (kudu::Thread::*)(boost::function, long*), kudu::Thread*, boost::function, long*) /usr/include/boost/thread/detail/thread.hpp:404 (mt-tablet-test+0x0000005b87a3) #3 kudu::Thread::StartThread(std::string const&, std::string const&, boost::function const&, scoped_refptr*) /home/mpercy/src/kudu/src/util/thread.cc:401 (mt-tablet-test+0x0000005b665e) #4 kudu::Status kudu::Thread::Create >::*)(int), kudu::tablet::MultiThreadedTabletTest >*, int>(std::string const&, std::string const&, void (kudu::tablet::MultiThreadedTabletTest >::* const&)(int), kudu::tablet::MultiThreadedTabletTest >* const&, int const&, scoped_refptr*) /home/mpercy/src/kudu/src/util/thread.h:129 (mt-tablet-test+0x0000003b6710) #5 void kudu::tablet::MultiThreadedTabletTest >::StartThreads >::*)(int)>(int, void (kudu::tablet::MultiThreadedTabletTest >::* const&)(int)) /home/mpercy/src/kudu/src/tablet/mt-tablet-test.cc:317 (mt-tablet-test+0x0000003b5196) #6 kudu::tablet::MultiThreadedTabletTest_DoTestAllAtOnce_Test >::TestBody() /home/mpercy/src/kudu/src/tablet/mt-tablet-test.cc:347 (mt-tablet-test+0x0000003d8bea) #7 void testing::internal::HandleSehExceptionsInMethodIfSupported(testing::Test*, void (testing::Test::*)(), char const*) :0 (mt-tablet-test+0x00000067b580) #8 __libc_start_main /build/buildd/eglibc-2.17/csu/libc-start.c:260 (libc.so.6+0x000000021de4) SUMMARY: ThreadSanitizer: data race /usr/lib/gcc/x86_64-linux-gnu/4.8/../../../../include/c++/4.8/bits/move.h:177 void std::swap(kudu::tablet::MemRowSet*&, kudu::tablet::MemRowSet*&) ================== I0528 18:07:30.417295 31967 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:30.417382 31967 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:30.417433 31967 compaction.cc:551] memrowset(0 bytes) I0528 18:07:30.417487 31967 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:30.417538 31967 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:30.418457 31967 diskrowset.cc:94] Opened CFile writer for column key[int64 NOT NULL] I0528 18:07:30.421103 31967 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:30.423481 31967 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:30.548866 31967 cfile_set.cc:71] Successfully opened cfile for column key[int64 NOT NULL] in RowSet(1) I0528 18:07:30.551491 31967 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:30.552767 31967 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:30.554064 31967 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:30.558131 31967 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:30.561581 31967 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:30.561655 31967 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 1845}] I0528 18:07:30.607571 31948 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 0.501, "inserted": 1734.000, "scanned": 12444.000, "updated": 80.000, "num_rowsets": 1.000, "memrowset_kb": 1536.000} I0528 18:07:30.618680 31967 delta_tracker.cc:528] Flushing 55 deltas... I0528 18:07:30.620456 31967 delta_tracker.cc:475] Flushed delta block: e17cd746fbd1484e856d0cb8503a068a I0528 18:07:30.622016 31967 delta_tracker.cc:487] Reopened delta block for read: e17cd746fbd1484e856d0cb8503a068a I0528 18:07:30.647565 31967 tablet.cc:1207] Flush successful on 776 rows (74541 bytes) I0528 18:07:30.655298 31968 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:30.655387 31968 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:30.655449 31968 compaction.cc:551] RowSet(0)(3800 bytes) I0528 18:07:30.655524 31968 compaction.cc:551] RowSet(1)(9105 bytes) I0528 18:07:30.655593 31968 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:30.655623 31967 delta_tracker.cc:528] Flushing 7 deltas... I0528 18:07:30.659155 31967 delta_tracker.cc:475] Flushed delta block: cc0cd898fb2e4d1b91e6aa63d1f6ed8e I0528 18:07:30.659694 31967 delta_tracker.cc:487] Reopened delta block for read: cc0cd898fb2e4d1b91e6aa63d1f6ed8e I0528 18:07:30.663921 31968 diskrowset.cc:94] Opened CFile writer for column key[int64 NOT NULL] I0528 18:07:30.664662 31968 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:30.665289 31968 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:30.750169 31967 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:30.750249 31967 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:30.750308 31967 compaction.cc:551] memrowset(0 bytes) I0528 18:07:30.750365 31967 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:30.750419 31967 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:30.753995 31967 diskrowset.cc:94] Opened CFile writer for column key[int64 NOT NULL] I0528 18:07:30.754350 31967 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:30.754703 31967 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:30.784065 31968 cfile_set.cc:71] Successfully opened cfile for column key[int64 NOT NULL] in RowSet(2) I0528 18:07:30.784327 31968 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(2) I0528 18:07:30.784503 31968 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(2) I0528 18:07:30.784880 31968 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:30.787554 31968 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:30.791822 31968 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:30.791908 31968 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2824}] I0528 18:07:30.824283 31968 delta_tracker.cc:528] Flushing 23 deltas... I0528 18:07:30.831969 31968 delta_tracker.cc:475] Flushed delta block: 349558c04eac4822a343e73a86314bdc I0528 18:07:30.832797 31968 delta_tracker.cc:487] Reopened delta block for read: 349558c04eac4822a343e73a86314bdc I0528 18:07:30.857810 31948 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 0.751, "inserted": 2448.000, "scanned": 23053.000, "updated": 110.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:30.859793 31968 tablet.cc:1207] Compaction successful on 1088 rows (78042 bytes) I0528 18:07:30.975672 31967 cfile_set.cc:71] Successfully opened cfile for column key[int64 NOT NULL] in RowSet(3) I0528 18:07:30.975908 31967 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(3) I0528 18:07:30.976078 31967 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(3) I0528 18:07:30.976586 31967 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:30.979843 31967 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:30.983695 31967 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:30.983779 31967 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 3423}] I0528 18:07:31.108013 31948 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 1.001, "inserted": 3672.000, "scanned": 34988.000, "updated": 170.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:31.115530 31967 tablet.cc:1207] Flush successful on 1544 rows (83272 bytes) I0528 18:07:31.120669 31967 delta_tracker.cc:528] Flushing 9 deltas... I0528 18:07:31.127610 31967 delta_tracker.cc:475] Flushed delta block: 5306123fda2c447c9daade6d09e11e6d I0528 18:07:31.128121 31967 delta_tracker.cc:487] Reopened delta block for read: 5306123fda2c447c9daade6d09e11e6d W0528 18:07:31.135761 31573 thread.cc:359] Waited for 1000ms trying to join with test0 I0528 18:07:31.162379 31968 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:31.162473 31968 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:31.162528 31968 compaction.cc:551] RowSet(2)(12606 bytes) I0528 18:07:31.162591 31968 compaction.cc:551] RowSet(3)(17836 bytes) I0528 18:07:31.162652 31968 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:31.164165 31968 diskrowset.cc:94] Opened CFile writer for column key[int64 NOT NULL] I0528 18:07:31.164543 31968 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:31.164913 31968 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:31.274520 31967 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:31.274643 31967 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:31.274727 31967 compaction.cc:551] memrowset(0 bytes) I0528 18:07:31.274796 31967 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:31.274852 31967 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:31.275688 31967 diskrowset.cc:94] Opened CFile writer for column key[int64 NOT NULL] I0528 18:07:31.276063 31967 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:31.276412 31967 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:31.358260 31948 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 1.251, "inserted": 4692.000, "scanned": 52469.000, "updated": 220.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:31.434129 31968 cfile_set.cc:71] Successfully opened cfile for column key[int64 NOT NULL] in RowSet(4) I0528 18:07:31.434383 31968 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(4) I0528 18:07:31.434669 31968 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(4) I0528 18:07:31.435221 31968 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:31.438689 31968 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:31.441699 31968 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:31.441778 31968 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 5749}] I0528 18:07:31.513545 31968 delta_tracker.cc:528] Flushing 69 deltas... I0528 18:07:31.514925 31968 delta_tracker.cc:475] Flushed delta block: 9a719e0c5f2945dea74a71a281e73257 I0528 18:07:31.519983 31968 delta_tracker.cc:487] Reopened delta block for read: 9a719e0c5f2945dea74a71a281e73257 I0528 18:07:31.539551 31968 tablet.cc:1207] Compaction successful on 2632 rows (95749 bytes) I0528 18:07:31.608501 31948 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 1.501, "inserted": 5998.000, "scanned": 64837.000, "updated": 290.000, "num_rowsets": 3.000, "memrowset_kb": 1536.000} I0528 18:07:31.663261 31967 cfile_set.cc:71] Successfully opened cfile for column key[int64 NOT NULL] in RowSet(5) I0528 18:07:31.663511 31967 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(5) I0528 18:07:31.663702 31967 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(5) I0528 18:07:31.664204 31967 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:31.671386 31967 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:31.674352 31967 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:31.674443 31967 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 6997}] I0528 18:07:31.839766 31967 tablet.cc:1207] Flush successful on 2125 rows (89927 bytes) I0528 18:07:31.841027 31968 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:31.841104 31968 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:31.841159 31968 compaction.cc:551] RowSet(4)(30315 bytes) I0528 18:07:31.841227 31968 compaction.cc:551] RowSet(5)(24493 bytes) I0528 18:07:31.841290 31968 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:31.842794 31968 diskrowset.cc:94] Opened CFile writer for column key[int64 NOT NULL] I0528 18:07:31.843233 31968 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:31.843618 31968 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:31.852493 31967 delta_tracker.cc:528] Flushing 72 deltas... I0528 18:07:31.854650 31967 delta_tracker.cc:475] Flushed delta block: e5eff14173a74be2b4495e5b2a6dd870 I0528 18:07:31.855093 31967 delta_tracker.cc:487] Reopened delta block for read: e5eff14173a74be2b4495e5b2a6dd870 I0528 18:07:31.858753 31948 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 1.752, "inserted": 7284.000, "scanned": 78715.000, "updated": 320.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:32.108999 31948 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 2.002, "inserted": 8000.000, "scanned": 91498.000, "updated": 350.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:32.260735 31968 cfile_set.cc:71] Successfully opened cfile for column key[int64 NOT NULL] in RowSet(6) I0528 18:07:32.260964 31968 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(6) I0528 18:07:32.261129 31968 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(6) I0528 18:07:32.261520 31968 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:32.263592 31968 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:32.263799 31968 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:32.263844 31968 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 8359}] I0528 18:07:32.312260 31968 delta_tracker.cc:528] Flushing 30 deltas... I0528 18:07:32.313220 31968 delta_tracker.cc:475] Flushed delta block: 6ee194e2c7c94b82a4d5e3316cb04ad7 I0528 18:07:32.313529 31968 delta_tracker.cc:487] Reopened delta block for read: 6ee194e2c7c94b82a4d5e3316cb04ad7 I0528 18:07:32.327891 31968 tablet.cc:1207] Compaction successful on 4757 rows (120194 bytes) I0528 18:07:32.359253 31948 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 2.252, "inserted": 8000.000, "scanned": 91498.000, "updated": 350.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:32.391898 31573 mt-tablet-test.cc:358] Sum = 31996000 I0528 18:07:32.391985 31573 mt-tablet-test.cc:356] Times for Summing int32 column: real 0.049s user 0.048s sys 0.004s I0528 18:07:32.549490 31573 tablet-test-base.h:736] Successfully verified 8000rows [ OK ] MultiThreadedTabletTest/8.DoTestAllAtOnce (2497 ms) [ RUN ] MultiThreadedTabletTest/8.DeleteAndReinsert I0528 18:07:32.592439 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:32.592864 31971 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 0.000} I0528 18:07:32.619566 31972 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:32.619652 31972 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:32.619704 31972 compaction.cc:551] memrowset(0 bytes) I0528 18:07:32.619755 31972 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:32.619808 31972 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:32.621060 31972 diskrowset.cc:94] Opened CFile writer for column key[int64 NOT NULL] I0528 18:07:32.621675 31972 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:32.627670 31972 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:32.630764 31972 tablet.cc:1086] Flush resulted in no output rows (all input rows were GCed!) Removing all input rowsets. I0528 18:07:32.668551 31972 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:32.668649 31972 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:32.668705 31972 compaction.cc:551] memrowset(0 bytes) I0528 18:07:32.668746 31972 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:32.668787 31972 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:32.670296 31972 diskrowset.cc:94] Opened CFile writer for column key[int64 NOT NULL] I0528 18:07:32.670770 31972 diskrowset.cc:94] Opened CFile writer for column val[uint32 NOT NULL] I0528 18:07:32.671284 31972 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] W0528 18:07:32.675179 31972 compaction.cc:654] Found REINSERT REDO truncating row history for Row: (int64 key=-8, uint32 val=8, uint32 update_count=1) Redo Mutations: [@32(SET update_count=4), @34(SET update_count=5), @41(SET update_count=6), @42(DELETE), @52(REINSERT (int64 key=-8, uint32 val=8, uint32 update_count=1)), @58(SET update_count=8), @62(SET update_count=9), @77(DELETE), @83(REINSERT (int64 key=-8, uint32 val=8, uint32 update_count=2)), @90(DELETE), @98(REINSERT (int64 key=-8, uint32 val=8, uint32 update_count=3)), @103(SET update_count=11), @121(DELETE), @143(REINSERT (int64 key=-8, uint32 val=8, uint32 update_count=4)), @152(DELETE), @164(REINSERT (int64 key=-8, uint32 val=8, uint32 update_count=5)), @170(SET update_count=14), @175(SET update_count=15), @176(DELETE), @220(REINSERT (int64 key=-8, uint32 val=8, uint32 update_count=6)), @223(SET update_count=18), @227(SET update_count=19), @229(DELETE), @260(REINSERT (int64 key=-8, uint32 val=8, uint32 update_count=7)), @271(SET update_count=22), @275(SET update_count=23), @277(DELETE), @312(REINSERT (int64 key=-8, uint32 val=8, uint32 update_count=8)), @313(SET update_count=25), @319(SET update_count=26), @337(DELETE)] Undo Mutations: [@30(DELETE)] Note: this warning will appear only for the first truncated row W0528 18:07:32.679776 31972 compaction.cc:764] Total 61 rows lost some history due to REINSERT after DELETE I0528 18:07:32.683445 31972 cfile_set.cc:71] Successfully opened cfile for column key[int64 NOT NULL] in RowSet(1) I0528 18:07:32.683696 31972 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NOT NULL] in RowSet(1) I0528 18:07:32.683890 31972 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:32.684416 31972 delta_tracker.cc:214] Successfully opened delta file 0 I0528 18:07:32.684784 31972 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:32.688812 31972 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:32.691860 31972 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:32.691932 31972 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 536}] I0528 18:07:32.698154 31972 delta_tracker.cc:528] Flushing 5 deltas... I0528 18:07:32.698890 31972 delta_tracker.cc:475] Flushed delta block: 092362b5ba80400eaf8f0d1bbc22ad5d I0528 18:07:32.699331 31972 delta_tracker.cc:487] Reopened delta block for read: 092362b5ba80400eaf8f0d1bbc22ad5d I0528 18:07:32.716907 31972 tablet.cc:1207] Flush successful on 10 rows (65839 bytes) I0528 18:07:32.843062 31971 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 0.250} I0528 18:07:33.093273 31971 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 0.500} I0528 18:07:33.343587 31971 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 0.751} I0528 18:07:33.594214 31971 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 1.001} W0528 18:07:33.739547 31573 thread.cc:359] Waited for 1000ms trying to join with test0 I0528 18:07:33.844598 31971 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 1.252} I0528 18:07:34.095003 31971 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/8", "time": 1.502} [ OK ] MultiThreadedTabletTest/8.DeleteAndReinsert (1657 ms) [----------] 2 tests from MultiThreadedTabletTest/8 (4154 ms total) [----------] 2 tests from MultiThreadedTabletTest/9, where TypeParam = kudu::tablet::NullableValueTestSetup [ RUN ] MultiThreadedTabletTest/9.DoTestAllAtOnce I0528 18:07:34.249155 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:34.249574 31994 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/9", "time": 0.000} I0528 18:07:34.272387 32016 mt-tablet-test.cc:88] Update thread using schema: Schema [key[uint32 NOT NULL], val[uint32 NULLABLE], update_count[uint32 NOT NULL]] I0528 18:07:34.293889 32013 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:34.293972 32013 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:34.294044 32013 compaction.cc:551] memrowset(0 bytes) I0528 18:07:34.294082 32013 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:34.294639 32013 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:34.295814 32013 diskrowset.cc:94] Opened CFile writer for column key[uint32 NOT NULL] I0528 18:07:34.296221 32013 diskrowset.cc:94] Opened CFile writer for column val[uint32 NULLABLE] I0528 18:07:34.296525 32013 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:34.335731 32013 cfile_set.cc:71] Successfully opened cfile for column key[uint32 NOT NULL] in RowSet(0) I0528 18:07:34.335916 32013 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NULLABLE] in RowSet(0) I0528 18:07:34.336117 32013 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(0) I0528 18:07:34.337671 32013 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:34.343911 32013 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:34.345423 32013 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:34.345500 32013 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 450}] I0528 18:07:34.375566 32013 delta_tracker.cc:528] Flushing 13 deltas... I0528 18:07:34.377439 32013 delta_tracker.cc:475] Flushed delta block: b0b5e0954dff45a39b8651bdfa066d19 I0528 18:07:34.377885 32013 delta_tracker.cc:487] Reopened delta block for read: b0b5e0954dff45a39b8651bdfa066d19 I0528 18:07:34.435353 32013 tablet.cc:1207] Flush successful on 147 rows (66395 bytes) I0528 18:07:34.440810 32013 delta_tracker.cc:528] Flushing 3 deltas... I0528 18:07:34.452198 32013 delta_tracker.cc:475] Flushed delta block: 3f260211e3004982a1565446669834d7 I0528 18:07:34.453096 32013 delta_tracker.cc:487] Reopened delta block for read: 3f260211e3004982a1565446669834d7 I0528 18:07:34.499806 31994 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/9", "time": 0.250, "inserted": 918.000, "scanned": 4518.000, "updated": 30.000, "num_rowsets": 0.000, "memrowset_kb": 1536.000} I0528 18:07:34.514880 32013 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:34.514977 32013 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:34.515082 32013 compaction.cc:551] memrowset(0 bytes) I0528 18:07:34.515126 32013 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:34.521800 32013 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:34.522681 32013 diskrowset.cc:94] Opened CFile writer for column key[uint32 NOT NULL] I0528 18:07:34.524173 32013 diskrowset.cc:94] Opened CFile writer for column val[uint32 NULLABLE] I0528 18:07:34.528766 32013 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:34.715889 32013 cfile_set.cc:71] Successfully opened cfile for column key[uint32 NOT NULL] in RowSet(1) I0528 18:07:34.716223 32013 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NULLABLE] in RowSet(1) I0528 18:07:34.717881 32013 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:34.718499 32013 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:34.724143 32013 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:34.739262 32013 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:34.739356 32013 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2804}] I0528 18:07:34.750066 31994 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/9", "time": 0.500, "inserted": 2346.000, "scanned": 11791.000, "updated": 60.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:34.826231 32013 delta_tracker.cc:528] Flushing 43 deltas... I0528 18:07:34.827792 32013 delta_tracker.cc:475] Flushed delta block: c8d344def64a4dba96f3b4638296f8ef I0528 18:07:34.828346 32013 delta_tracker.cc:487] Reopened delta block for read: c8d344def64a4dba96f3b4638296f8ef I0528 18:07:34.856612 32013 tablet.cc:1207] Flush successful on 1206 rows (71325 bytes) I0528 18:07:34.871150 32013 delta_tracker.cc:528] Flushing 7 deltas... I0528 18:07:34.874229 32013 delta_tracker.cc:475] Flushed delta block: c5f7f34d5b6e4875b07132687863973e I0528 18:07:34.874770 32013 delta_tracker.cc:487] Reopened delta block for read: c5f7f34d5b6e4875b07132687863973e I0528 18:07:34.920214 32014 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:34.920303 32014 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:34.920358 32014 compaction.cc:551] RowSet(0)(955 bytes) I0528 18:07:34.920431 32014 compaction.cc:551] RowSet(1)(5885 bytes) I0528 18:07:34.920502 32014 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:34.922281 32014 diskrowset.cc:94] Opened CFile writer for column key[uint32 NOT NULL] I0528 18:07:34.922708 32014 diskrowset.cc:94] Opened CFile writer for column val[uint32 NULLABLE] I0528 18:07:34.923065 32014 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:34.995249 32013 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:34.995354 32013 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:34.995420 32013 compaction.cc:551] memrowset(0 bytes) I0528 18:07:34.995479 32013 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:34.995539 32013 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:34.996525 32013 diskrowset.cc:94] Opened CFile writer for column key[uint32 NOT NULL] I0528 18:07:34.996875 32013 diskrowset.cc:94] Opened CFile writer for column val[uint32 NULLABLE] I0528 18:07:34.997189 32013 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:35.000315 31994 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/9", "time": 0.751, "inserted": 3774.000, "scanned": 20592.000, "updated": 90.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:35.050395 32014 cfile_set.cc:71] Successfully opened cfile for column key[uint32 NOT NULL] in RowSet(2) I0528 18:07:35.050638 32014 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NULLABLE] in RowSet(2) I0528 18:07:35.050815 32014 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(2) I0528 18:07:35.051465 32014 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:35.055073 32014 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:35.066860 32014 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:35.066956 32014 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 4312}] I0528 18:07:35.113394 32014 delta_tracker.cc:528] Flushing 17 deltas... I0528 18:07:35.117388 32014 delta_tracker.cc:475] Flushed delta block: 030412c62b5640aa9e07787f56f374e6 I0528 18:07:35.117952 32014 delta_tracker.cc:487] Reopened delta block for read: 030412c62b5640aa9e07787f56f374e6 I0528 18:07:35.150145 32014 tablet.cc:1207] Compaction successful on 1353 rows (71989 bytes) I0528 18:07:35.250572 31994 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/9", "time": 1.001, "inserted": 4998.000, "scanned": 30264.000, "updated": 130.000, "num_rowsets": 3.000, "memrowset_kb": 1536.000} W0528 18:07:35.273537 31573 thread.cc:359] Waited for 1000ms trying to join with test0 I0528 18:07:35.401157 32013 cfile_set.cc:71] Successfully opened cfile for column key[uint32 NOT NULL] in RowSet(3) I0528 18:07:35.401450 32013 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NULLABLE] in RowSet(3) I0528 18:07:35.401697 32013 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(3) I0528 18:07:35.402279 32013 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:35.406224 32013 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:35.410615 32013 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:35.410728 32013 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 6660}] I0528 18:07:35.500795 31994 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/9", "time": 1.251, "inserted": 6590.000, "scanned": 40330.000, "updated": 160.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:35.656352 32014 tablet.cc:1229] Compaction: stage 1 complete, picked 2 rowsets to compact I0528 18:07:35.656461 32014 compaction.cc:548] Selected 2 rowsets to compact: I0528 18:07:35.656525 32014 compaction.cc:551] RowSet(2)(6549 bytes) I0528 18:07:35.656602 32014 compaction.cc:551] RowSet(3)(12890 bytes) I0528 18:07:35.656672 32014 tablet.cc:1056] Compaction: entering phase 1 (flushing snapshot) I0528 18:07:35.658396 32013 tablet.cc:1207] Flush successful on 2731 rows (78330 bytes) I0528 18:07:35.672606 32013 delta_tracker.cc:528] Flushing 87 deltas... I0528 18:07:35.674149 32014 diskrowset.cc:94] Opened CFile writer for column key[uint32 NOT NULL] I0528 18:07:35.674619 32014 diskrowset.cc:94] Opened CFile writer for column val[uint32 NULLABLE] I0528 18:07:35.675024 32013 delta_tracker.cc:475] Flushed delta block: 4bca13cd09d3471389751eda9a0137c3 I0528 18:07:35.675024 32014 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:35.675531 32013 delta_tracker.cc:487] Reopened delta block for read: 4bca13cd09d3471389751eda9a0137c3 I0528 18:07:35.751071 31994 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/9", "time": 1.501, "inserted": 8000.000, "scanned": 50020.000, "updated": 200.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:35.893266 32014 cfile_set.cc:71] Successfully opened cfile for column key[uint32 NOT NULL] in RowSet(4) I0528 18:07:35.893471 32014 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NULLABLE] in RowSet(4) I0528 18:07:35.893616 32014 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(4) I0528 18:07:35.893980 32014 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:35.896014 32014 tablet.cc:1144] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:35.896209 32014 tablet.cc:1169] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:35.896245 32014 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 8210}] I0528 18:07:35.937683 32014 delta_tracker.cc:528] Flushing 16 deltas... I0528 18:07:35.938498 32014 delta_tracker.cc:475] Flushed delta block: 5a0760c35aea432680798fc407954f44 I0528 18:07:35.938767 32014 delta_tracker.cc:487] Reopened delta block for read: 5a0760c35aea432680798fc407954f44 I0528 18:07:35.948007 32014 tablet.cc:1207] Compaction successful on 4084 rows (84765 bytes) I0528 18:07:36.001354 31994 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/9", "time": 1.752, "inserted": 8000.000, "scanned": 55538.000, "updated": 200.000, "num_rowsets": 2.000, "memrowset_kb": 1536.000} I0528 18:07:36.033900 31573 mt-tablet-test.cc:358] Sum = 2608808287907 I0528 18:07:36.034008 31573 mt-tablet-test.cc:356] Times for Summing int32 column: real 0.066s user 0.064s sys 0.000s I0528 18:07:36.237128 31573 tablet-test-base.h:736] Successfully verified 8000rows [ OK ] MultiThreadedTabletTest/9.DoTestAllAtOnce (2030 ms) [ RUN ] MultiThreadedTabletTest/9.DeleteAndReinsert I0528 18:07:36.279021 31573 test_graph.cc:52] Starting metrics dumper I0528 18:07:36.279508 32018 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/9", "time": 0.000} I0528 18:07:36.288975 32019 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:36.289093 32019 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:36.289155 32019 compaction.cc:551] memrowset(0 bytes) I0528 18:07:36.289211 32019 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:36.289266 32019 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:36.291481 32019 diskrowset.cc:94] Opened CFile writer for column key[uint32 NOT NULL] I0528 18:07:36.294284 32019 diskrowset.cc:94] Opened CFile writer for column val[uint32 NULLABLE] I0528 18:07:36.295002 32019 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] I0528 18:07:36.302789 32019 tablet.cc:1086] Flush resulted in no output rows (all input rows were GCed!) Removing all input rowsets. I0528 18:07:36.358150 32019 tablet.cc:694] Flush: entering stage 1 (old memrowset already frozen for inserts) I0528 18:07:36.358258 32019 compaction.cc:548] Selected 1 rowsets to compact: I0528 18:07:36.358316 32019 compaction.cc:551] memrowset(0 bytes) I0528 18:07:36.358372 32019 tablet.cc:696] Memstore in-memory size: 1572864 bytes I0528 18:07:36.358414 32019 tablet.cc:1056] Flush: entering phase 1 (flushing snapshot) I0528 18:07:36.361544 32019 diskrowset.cc:94] Opened CFile writer for column key[uint32 NOT NULL] I0528 18:07:36.362164 32019 diskrowset.cc:94] Opened CFile writer for column val[uint32 NULLABLE] I0528 18:07:36.362551 32019 diskrowset.cc:94] Opened CFile writer for column update_count[uint32 NOT NULL] W0528 18:07:36.367095 32019 compaction.cc:654] Found REINSERT REDO truncating row history for Row: (uint32 key=0, uint32 val=0, uint32 update_count=1) Redo Mutations: [@8(SET update_count=1), @11(SET update_count=2), @15(DELETE), @24(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=1)), @28(SET update_count=5), @44(DELETE), @49(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=2)), @52(SET update_count=6), @53(SET update_count=7), @58(DELETE), @80(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=3)), @82(SET update_count=9), @87(SET update_count=10), @91(DELETE), @112(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=4)), @129(DELETE), @173(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=5)), @192(SET update_count=13), @197(SET update_count=14), @202(SET update_count=15), @206(DELETE), @225(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=6)), @230(SET update_count=17), @234(DELETE), @243(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=7)), @245(SET update_count=20), @251(DELETE), @271(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=8)), @274(SET update_count=22), @278(SET update_count=23), @289(DELETE), @295(REINSERT (uint32 key=0, uint32 val=0, uint32 update_count=9)), @304(SET update_count=25), @321(SET update_count=26), @328(SET update_count=27), @337(SET update_count=28), @344(DELETE)] Undo Mutations: [@6(DELETE)] Note: this warning will appear only for the first truncated row W0528 18:07:36.373193 32019 compaction.cc:764] Total 66 rows lost some history due to REINSERT after DELETE I0528 18:07:36.377142 32019 cfile_set.cc:71] Successfully opened cfile for column key[uint32 NOT NULL] in RowSet(1) I0528 18:07:36.377408 32019 cfile_set.cc:71] Successfully opened cfile for column val[uint32 NULLABLE] in RowSet(1) I0528 18:07:36.377626 32019 cfile_set.cc:71] Successfully opened cfile for column update_count[uint32 NOT NULL] in RowSet(1) I0528 18:07:36.378212 32019 delta_tracker.cc:214] Successfully opened delta file 0 I0528 18:07:36.378649 32019 delta_tracker.cc:240] Successfully opened undo delta file 0 I0528 18:07:36.381661 32019 tablet.cc:1144] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0528 18:07:36.384836 32019 tablet.cc:1169] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0528 18:07:36.384919 32019 tablet.cc:1170] Phase 2 snapshot: MvccSnapshot[committed={T|T < 512}] I0528 18:07:36.393267 32019 delta_tracker.cc:528] Flushing 13 deltas... I0528 18:07:36.394459 32019 delta_tracker.cc:475] Flushed delta block: 3b1921a9c6c4492ca4efaf90ed39b69e I0528 18:07:36.394904 32019 delta_tracker.cc:487] Reopened delta block for read: 3b1921a9c6c4492ca4efaf90ed39b69e I0528 18:07:36.412557 32019 tablet.cc:1207] Flush successful on 10 rows (65763 bytes) I0528 18:07:36.529700 32018 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/9", "time": 0.250} I0528 18:07:36.779896 32018 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/9", "time": 0.500} I0528 18:07:37.030113 32018 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/9", "time": 0.751} I0528 18:07:37.280410 32018 test_graph.cc:76] metrics: { "scope": "MultiThreadedTabletTest/9", "time": 1.001} [ OK ] MultiThreadedTabletTest/9.DeleteAndReinsert (1193 ms) [----------] 2 tests from MultiThreadedTabletTest/9 (3223 ms total) [----------] Global test environment tear-down [==========] 20 tests from 10 test cases ran. (30700 ms total) [ PASSED ] 20 tests. ThreadSanitizer: reported 1 warnings