WARNING: Perftools heap leak checker is active -- Performance may suffer [==========] Running 1 test from 1 test case. [----------] Global test environment set-up. [----------] 1 test from LinkedListTest [ RUN ] LinkedListTest.TestLoadAndVerify WARNING: Logging before InitGoogleLogging() is written to STDERR I0302 15:31:27.180140 28280 test_util.cc:117] Using random seed: 1425339087 I0302 15:31:27.180352 28280 linked_list-test.cc:63] Linked List Test Configuration: I0302 15:31:27.180368 28280 linked_list-test.cc:64] -------------- I0302 15:31:27.180380 28280 linked_list-test.cc:65] 50 chains I0302 15:31:27.180392 28280 linked_list-test.cc:66] 3 tablets I0302 15:31:27.180403 28280 linked_list-test.cc:67] Mutations off I0302 15:31:27.180420 28280 linked_list-test.cc:68] -------------- I0302 15:31:27.180462 28280 ts_itest-base.h:86] Starting cluster with: I0302 15:31:27.180476 28280 ts_itest-base.h:87] -------------- I0302 15:31:27.180490 28280 ts_itest-base.h:88] 3 tablet servers I0302 15:31:27.180501 28280 ts_itest-base.h:89] 3 replicas per TS I0302 15:31:27.180516 28280 ts_itest-base.h:90] -------------- I0302 15:31:27.184406 28280 external_mini_cluster.cc:382] Running /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-master kudu-master --master_wal_dir=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/master --master_data_dirs=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/master --master_rpc_bind_addresses=127.0.0.1:0 --master_web_port=0 --skip_remove_old_recovery_dir --enable_leader_failure_detection=true --server_dump_info_path=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/master/info.pb --server_dump_info_format=pb --logtostderr --logbuflevel=-1 --webserver_interface=localhost WARNING: Perftools heap leak checker is active -- Performance may suffer I0302 15:31:27.206073 28287 master_main.cc:27] Initializing master server... I0302 15:31:27.206359 28287 server_base.cc:109] Could not load existing FS layout: Not found: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/master/instance: No such file or directory (error 2) I0302 15:31:27.206370 28287 server_base.cc:110] Creating new FS layout I0302 15:31:27.213206 28287 fs_manager.cc:194] Generated new instance metadata in path /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/master/instance: uuid: "439499e89b4e414a91a72a98d4191bba" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:31:27.217648 28287 fs_manager.cc:132] Opened local filesystem: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/master uuid: "439499e89b4e414a91a72a98d4191bba" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:31:27.220587 28287 master_main.cc:30] Starting Master server... I0302 15:31:27.223482 28287 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:50914 I0302 15:31:27.223609 28287 webserver.cc:108] Starting webserver on localhost:0 I0302 15:31:27.223640 28287 webserver.cc:117] Document root disabled I0302 15:31:27.224151 28287 webserver.cc:197] Webserver started. Bound to: http://127.0.0.1:41309/ I0302 15:31:27.224382 28287 server_base.cc:170] Dumped server information to /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/master/info.pb I0302 15:31:27.227586 28280 external_mini_cluster.cc:416] Started /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-master as pid 28287 I0302 15:31:27.228039 28280 external_mini_cluster.cc:382] Running /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server kudu-tablet_server --tablet_server_wal_dir=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0 --tablet_server_data_dirs=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0 --tablet_server_rpc_bind_addresses=127.0.0.1:0 --tablet_server_web_port=0 --tablet_server_master_addrs=127.0.0.1:50914 --skip_remove_old_recovery_dir --enable_leader_failure_detection=true --tablet_server_rpc_bind_addresses=127.0.0.1:7050 --flush_threshold_mb=1 --log_segment_size_mb=1 --server_dump_info_path=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/info.pb --server_dump_info_format=pb --logtostderr --logbuflevel=-1 --webserver_interface=localhost I0302 15:31:27.232079 28314 tablet_bootstrap.cc:290] Tablet 00000000000000000000000000000000: Bootstrap starting. I0302 15:31:27.232686 28314 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 00000000000000000000000000000000 creating new one. I0302 15:31:27.233105 28314 log.cc:257] Log is configured to *not* fsync() on all Append() calls I0302 15:31:27.233520 28314 tablet_bootstrap.cc:290] Tablet 00000000000000000000000000000000: No bootstrap required, opened a new log I0302 15:31:27.235716 28317 change_config_transaction.cc:135] T 00000000000000000000000000000000 P 439499e89b4e414a91a72a98d4191bba: Configuration changed Changed from: opid_index: -1 local: true peers { permanent_uuid: "439499e89b4e414a91a72a98d4191bba" role: LEADER } Changed to: opid_index: 1 local: true peers { permanent_uuid: "439499e89b4e414a91a72a98d4191bba" role: LEADER } I0302 15:31:27.235756 28317 sys_catalog.cc:202] T 00000000000000000000000000000000 P 439499e89b4e414a91a72a98d4191bba [sys.catalog]: SysCatalogTable state changed. New quorum config:opid_index: 1 local: true peers { permanent_uuid: "439499e89b4e414a91a72a98d4191bba" role: LEADER } I0302 15:31:27.235764 28314 sys_catalog.cc:268] T 00000000000000000000000000000000 P 439499e89b4e414a91a72a98d4191bba [sys.catalog]: configured and running, proceeding with master startup. I0302 15:31:27.235770 28317 sys_catalog.cc:205] T 00000000000000000000000000000000 P 439499e89b4e414a91a72a98d4191bba [sys.catalog]: This master's current role is: LEADER, previous role was: FOLLOWER I0302 15:31:27.235890 28321 catalog_manager.cc:397] Loading tables and tablets metadata into memory... I0302 15:31:27.236861 28287 master_main.cc:33] Master server successfully started. WARNING: Perftools heap leak checker is active -- Performance may suffer I0302 15:31:27.249958 28315 tablet_server_main.cc:38] Initializing tablet server... I0302 15:31:27.250345 28315 server_base.cc:109] Could not load existing FS layout: Not found: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/instance: No such file or directory (error 2) I0302 15:31:27.250378 28315 server_base.cc:110] Creating new FS layout I0302 15:31:27.253147 28315 fs_manager.cc:194] Generated new instance metadata in path /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/instance: uuid: "892c1da145ed4847b1dfd57983516d8f" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:31:27.260710 28315 fs_manager.cc:132] Opened local filesystem: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0 uuid: "892c1da145ed4847b1dfd57983516d8f" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:31:27.264864 28315 tablet_server_main.cc:41] Starting tablet server... I0302 15:31:27.269245 28315 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:7050 I0302 15:31:27.269400 28315 webserver.cc:108] Starting webserver on localhost:0 I0302 15:31:27.269443 28315 webserver.cc:117] Document root disabled I0302 15:31:27.270026 28315 webserver.cc:197] Webserver started. Bound to: http://127.0.0.1:40132/ I0302 15:31:27.271057 28315 server_base.cc:170] Dumped server information to /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/info.pb I0302 15:31:27.271378 28315 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0302 15:31:27.271668 28315 tablet_server_main.cc:44] Tablet server successfully started. I0302 15:31:27.273003 28363 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:50914 I0302 15:31:27.273049 28363 heartbeater.cc:289] Registering TS with master... I0302 15:31:27.273104 28363 heartbeater.cc:295] Sending a full tablet report to master... I0302 15:31:27.273440 28293 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" instance_seqno: 1425339087269074 } with Master I0302 15:31:27.280714 28280 external_mini_cluster.cc:416] Started /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server as pid 28315 I0302 15:31:27.280872 28280 external_mini_cluster.cc:382] Running /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server kudu-tablet_server --tablet_server_wal_dir=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1 --tablet_server_data_dirs=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1 --tablet_server_rpc_bind_addresses=127.0.0.1:0 --tablet_server_web_port=0 --tablet_server_master_addrs=127.0.0.1:50914 --skip_remove_old_recovery_dir --enable_leader_failure_detection=true --tablet_server_rpc_bind_addresses=127.0.0.1:7051 --flush_threshold_mb=1 --log_segment_size_mb=1 --server_dump_info_path=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/info.pb --server_dump_info_format=pb --logtostderr --logbuflevel=-1 --webserver_interface=localhost WARNING: Perftools heap leak checker is active -- Performance may suffer I0302 15:31:27.310952 28367 tablet_server_main.cc:38] Initializing tablet server... I0302 15:31:27.311451 28367 server_base.cc:109] Could not load existing FS layout: Not found: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/instance: No such file or directory (error 2) I0302 15:31:27.311496 28367 server_base.cc:110] Creating new FS layout I0302 15:31:27.314712 28367 fs_manager.cc:194] Generated new instance metadata in path /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/instance: uuid: "5748afe5294c41b89cbb67f8edbee2a1" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:31:27.324005 28367 fs_manager.cc:132] Opened local filesystem: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1 uuid: "5748afe5294c41b89cbb67f8edbee2a1" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:31:27.327972 28367 tablet_server_main.cc:41] Starting tablet server... I0302 15:31:27.332317 28367 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:7051 I0302 15:31:27.332499 28367 webserver.cc:108] Starting webserver on localhost:0 I0302 15:31:27.332540 28367 webserver.cc:117] Document root disabled I0302 15:31:27.333123 28367 webserver.cc:197] Webserver started. Bound to: http://127.0.0.1:55689/ I0302 15:31:27.333370 28367 server_base.cc:170] Dumped server information to /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/info.pb I0302 15:31:27.333493 28367 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0302 15:31:27.333613 28367 tablet_server_main.cc:44] Tablet server successfully started. I0302 15:31:27.334805 28407 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:50914 I0302 15:31:27.334830 28407 heartbeater.cc:289] Registering TS with master... I0302 15:31:27.334861 28407 heartbeater.cc:295] Sending a full tablet report to master... I0302 15:31:27.335193 28295 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" instance_seqno: 1425339087332152 } with Master I0302 15:31:27.343536 28280 external_mini_cluster.cc:416] Started /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server as pid 28367 I0302 15:31:27.343690 28280 external_mini_cluster.cc:382] Running /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server kudu-tablet_server --tablet_server_wal_dir=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2 --tablet_server_data_dirs=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2 --tablet_server_rpc_bind_addresses=127.0.0.1:0 --tablet_server_web_port=0 --tablet_server_master_addrs=127.0.0.1:50914 --skip_remove_old_recovery_dir --enable_leader_failure_detection=true --tablet_server_rpc_bind_addresses=127.0.0.1:7052 --flush_threshold_mb=1 --log_segment_size_mb=1 --server_dump_info_path=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/info.pb --server_dump_info_format=pb --logtostderr --logbuflevel=-1 --webserver_interface=localhost WARNING: Perftools heap leak checker is active -- Performance may suffer I0302 15:31:27.367030 28410 tablet_server_main.cc:38] Initializing tablet server... I0302 15:31:27.367400 28410 server_base.cc:109] Could not load existing FS layout: Not found: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/instance: No such file or directory (error 2) I0302 15:31:27.367434 28410 server_base.cc:110] Creating new FS layout I0302 15:31:27.374202 28410 fs_manager.cc:194] Generated new instance metadata in path /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/instance: uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:31:27.382238 28410 fs_manager.cc:132] Opened local filesystem: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2 uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:31:27.384963 28410 tablet_server_main.cc:41] Starting tablet server... I0302 15:31:27.388187 28410 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:7052 I0302 15:31:27.388285 28410 webserver.cc:108] Starting webserver on localhost:0 I0302 15:31:27.388314 28410 webserver.cc:117] Document root disabled I0302 15:31:27.388809 28410 webserver.cc:197] Webserver started. Bound to: http://127.0.0.1:43948/ I0302 15:31:27.389026 28410 server_base.cc:170] Dumped server information to /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/info.pb I0302 15:31:27.389165 28410 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0302 15:31:27.389279 28410 tablet_server_main.cc:44] Tablet server successfully started. I0302 15:31:27.390460 28452 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:50914 I0302 15:31:27.390486 28452 heartbeater.cc:289] Registering TS with master... I0302 15:31:27.390522 28452 heartbeater.cc:295] Sending a full tablet report to master... I0302 15:31:27.390717 28297 ts_manager.cc:66] Registered new tablet server { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" instance_seqno: 1425339087388065 } with Master I0302 15:31:27.396075 28280 external_mini_cluster.cc:416] Started /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server as pid 28410 I0302 15:31:27.398056 28280 external_mini_cluster.cc:269] 3 TS(s) registered with Master W0302 15:31:27.398264 28286 reactor.cc:199] Client call ListTabletServers has no timeout set for connection id: {remote=127.0.0.1:50914, service_name=kudu.master.MasterService, user_credentials={real_user=jenkins, eff_user=}} I0302 15:31:27.403461 28301 catalog_manager.cc:562] CreateTable from {real_user=jenkins, eff_user=} at 127.0.0.1:56038: name: "TestTable" schema { columns { name: "rand_key" type: UINT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } columns { name: "link_to" type: UINT64 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } columns { name: "insert_ts" type: UINT64 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } columns { name: "updated" type: BOOL is_key: false is_nullable: false read_default_value: "\000" write_default_value: "\000" encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } } pre_split_keys: "UUUUUUUU" pre_split_keys: "\252\252\252\252\252\252\252\252" num_replicas: 3 I0302 15:31:27.406519 28341 tablet_service.cc:389] Processing CreateTablet for tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 (table=TestTable [id=da654aa442c644efaad896927d5ef31f]), range=["UUUUUUUU", "\xaa\xaa\xaa\xaa\xaa\xaa\xaa\xaa"] I0302 15:31:27.406910 28342 tablet_service.cc:389] Processing CreateTablet for tablet ad1251b8988446ffa0348b542d353bd4 (table=TestTable [id=da654aa442c644efaad896927d5ef31f]), range=["\xaa\xaa\xaa\xaa\xaa\xaa\xaa\xaa", ""] I0302 15:31:27.407053 28343 tablet_service.cc:389] Processing CreateTablet for tablet 36005aaac18b4c70b2fc03d1382ca7c3 (table=TestTable [id=da654aa442c644efaad896927d5ef31f]), range=["", "UUUUUUUU"] I0302 15:31:27.407194 28387 tablet_service.cc:389] Processing CreateTablet for tablet 36005aaac18b4c70b2fc03d1382ca7c3 (table=TestTable [id=da654aa442c644efaad896927d5ef31f]), range=["", "UUUUUUUU"] I0302 15:31:27.407199 28385 tablet_service.cc:389] Processing CreateTablet for tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 (table=TestTable [id=da654aa442c644efaad896927d5ef31f]), range=["UUUUUUUU", "\xaa\xaa\xaa\xaa\xaa\xaa\xaa\xaa"] I0302 15:31:27.407488 28386 tablet_service.cc:389] Processing CreateTablet for tablet ad1251b8988446ffa0348b542d353bd4 (table=TestTable [id=da654aa442c644efaad896927d5ef31f]), range=["\xaa\xaa\xaa\xaa\xaa\xaa\xaa\xaa", ""] I0302 15:31:27.408730 28430 tablet_service.cc:389] Processing CreateTablet for tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 (table=TestTable [id=da654aa442c644efaad896927d5ef31f]), range=["UUUUUUUU", "\xaa\xaa\xaa\xaa\xaa\xaa\xaa\xaa"] I0302 15:31:27.408903 28431 tablet_service.cc:389] Processing CreateTablet for tablet 36005aaac18b4c70b2fc03d1382ca7c3 (table=TestTable [id=da654aa442c644efaad896927d5ef31f]), range=["", "UUUUUUUU"] I0302 15:31:27.408917 28432 tablet_service.cc:389] Processing CreateTablet for tablet ad1251b8988446ffa0348b542d353bd4 (table=TestTable [id=da654aa442c644efaad896927d5ef31f]), range=["\xaa\xaa\xaa\xaa\xaa\xaa\xaa\xaa", ""] I0302 15:31:27.441987 28431 ts_tablet_manager.cc:449] Registered tablet 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:31:27.442085 28341 ts_tablet_manager.cc:449] Registered tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:31:27.442534 28468 ts_tablet_manager.cc:314] Bootstrapping tablet: 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:31:27.443112 28467 ts_tablet_manager.cc:314] Bootstrapping tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:31:27.443635 28468 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap starting. I0302 15:31:27.443822 28343 ts_tablet_manager.cc:449] Registered tablet 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:31:27.443990 28467 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap starting. I0302 15:31:27.444133 28469 ts_tablet_manager.cc:314] Bootstrapping tablet: 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:31:27.444427 28468 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 36005aaac18b4c70b2fc03d1382ca7c3 creating new one. I0302 15:31:27.444712 28467 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 creating new one. I0302 15:31:27.444886 28468 log.cc:257] Log is configured to *not* fsync() on all Append() calls I0302 15:31:27.444895 28386 ts_tablet_manager.cc:449] Registered tablet ad1251b8988446ffa0348b542d353bd4 I0302 15:31:27.445263 28467 log.cc:257] Log is configured to *not* fsync() on all Append() calls I0302 15:31:27.445555 28469 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap starting. I0302 15:31:27.445983 28470 ts_tablet_manager.cc:314] Bootstrapping tablet: ad1251b8988446ffa0348b542d353bd4 I0302 15:31:27.446732 28470 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap starting. I0302 15:31:27.447465 28469 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 36005aaac18b4c70b2fc03d1382ca7c3 creating new one. I0302 15:31:27.447777 28468 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: No bootstrap required, opened a new log I0302 15:31:27.447834 28470 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: ad1251b8988446ffa0348b542d353bd4 creating new one. I0302 15:31:27.447836 28468 ts_tablet_manager.cc:319] Time spent tablet 36005aaac18b4c70b2fc03d1382ca7c3 bootstrap: real 0.005s user 0.001s sys 0.001s I0302 15:31:27.448271 28469 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: No bootstrap required, opened a new log I0302 15:31:27.448323 28469 ts_tablet_manager.cc:319] Time spent tablet 36005aaac18b4c70b2fc03d1382ca7c3 bootstrap: real 0.004s user 0.002s sys 0.000s I0302 15:31:27.448524 28467 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: No bootstrap required, opened a new log I0302 15:31:27.448639 28467 ts_tablet_manager.cc:319] Time spent tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 bootstrap: real 0.005s user 0.002s sys 0.000s I0302 15:31:27.449106 28470 log.cc:257] Log is configured to *not* fsync() on all Append() calls I0302 15:31:27.449978 28387 ts_tablet_manager.cc:449] Registered tablet 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:31:27.450160 28470 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: No bootstrap required, opened a new log I0302 15:31:27.450161 28468 raft_consensus.cc:194] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:31:27.450213 28468 raft_consensus.cc:211] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:31:27.450213 28470 ts_tablet_manager.cc:319] Time spent tablet ad1251b8988446ffa0348b542d353bd4 bootstrap: real 0.004s user 0.001s sys 0.001s I0302 15:31:27.450302 28468 raft_consensus.cc:399] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41e55c8a3a40e3bf81f862aaadfd20, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0302 15:31:27.450351 28468 consensus_queue.cc:127] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:31:27.450389 28480 ts_tablet_manager.cc:314] Bootstrapping tablet: 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:31:27.450527 28468 ts_tablet_manager.cc:339] Time spent starting tablet 36005aaac18b4c70b2fc03d1382ca7c3: real 0.003s user 0.003s sys 0.000s I0302 15:31:27.450718 28432 ts_tablet_manager.cc:449] Registered tablet ad1251b8988446ffa0348b542d353bd4 I0302 15:31:27.450769 28468 ts_tablet_manager.cc:314] Bootstrapping tablet: ad1251b8988446ffa0348b542d353bd4 I0302 15:31:27.451627 28468 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap starting. I0302 15:31:27.452292 28468 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: ad1251b8988446ffa0348b542d353bd4 creating new one. I0302 15:31:27.452644 28469 raft_consensus.cc:194] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:31:27.452697 28469 raft_consensus.cc:211] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:31:27.452800 28469 raft_consensus.cc:399] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Becoming Follower/Learner. State: Replica: 892c1da145ed4847b1dfd57983516d8f, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0302 15:31:27.452831 28469 consensus_queue.cc:127] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:31:27.452961 28469 ts_tablet_manager.cc:339] Time spent starting tablet 36005aaac18b4c70b2fc03d1382ca7c3: real 0.005s user 0.004s sys 0.001s I0302 15:31:27.453086 28342 ts_tablet_manager.cc:449] Registered tablet ad1251b8988446ffa0348b542d353bd4 I0302 15:31:27.453131 28469 ts_tablet_manager.cc:314] Bootstrapping tablet: ad1251b8988446ffa0348b542d353bd4 I0302 15:31:27.453295 28468 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: No bootstrap required, opened a new log I0302 15:31:27.453338 28430 ts_tablet_manager.cc:449] Registered tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:31:27.453356 28468 ts_tablet_manager.cc:319] Time spent tablet ad1251b8988446ffa0348b542d353bd4 bootstrap: real 0.003s user 0.002s sys 0.000s I0302 15:31:27.453373 28470 raft_consensus.cc:194] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:31:27.453423 28470 raft_consensus.cc:211] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:31:27.453500 28470 raft_consensus.cc:399] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0302 15:31:27.453513 28485 ts_tablet_manager.cc:314] Bootstrapping tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:31:27.453551 28470 consensus_queue.cc:127] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:31:27.453748 28385 ts_tablet_manager.cc:449] Registered tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:31:27.453780 28470 ts_tablet_manager.cc:339] Time spent starting tablet ad1251b8988446ffa0348b542d353bd4: real 0.004s user 0.002s sys 0.001s I0302 15:31:27.453898 28486 ts_tablet_manager.cc:314] Bootstrapping tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:31:27.454181 28467 raft_consensus.cc:194] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:31:27.454210 28467 raft_consensus.cc:211] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:31:27.454280 28467 raft_consensus.cc:399] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Becoming Follower/Learner. State: Replica: 892c1da145ed4847b1dfd57983516d8f, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0302 15:31:27.454330 28467 consensus_queue.cc:127] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:31:27.454396 28469 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap starting. I0302 15:31:27.454499 28467 ts_tablet_manager.cc:339] Time spent starting tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: real 0.006s user 0.002s sys 0.003s I0302 15:31:27.454776 28469 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: ad1251b8988446ffa0348b542d353bd4 creating new one. I0302 15:31:27.455137 28480 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap starting. I0302 15:31:27.455569 28486 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap starting. I0302 15:31:27.455673 28485 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap starting. I0302 15:31:27.455907 28469 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: No bootstrap required, opened a new log I0302 15:31:27.455960 28469 ts_tablet_manager.cc:319] Time spent tablet ad1251b8988446ffa0348b542d353bd4 bootstrap: real 0.003s user 0.000s sys 0.001s I0302 15:31:27.456187 28480 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 36005aaac18b4c70b2fc03d1382ca7c3 creating new one. I0302 15:31:27.456419 28485 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 creating new one. I0302 15:31:27.456539 28486 tablet_bootstrap.cc:387] No previous blocks or log segments found for tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 creating new one. I0302 15:31:27.456701 28469 raft_consensus.cc:194] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:31:27.456704 28468 raft_consensus.cc:194] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:31:27.456720 28469 raft_consensus.cc:211] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:31:27.456730 28468 raft_consensus.cc:211] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:31:27.456748 28469 raft_consensus.cc:399] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Becoming Follower/Learner. State: Replica: 892c1da145ed4847b1dfd57983516d8f, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0302 15:31:27.456763 28469 consensus_queue.cc:127] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:31:27.456774 28468 raft_consensus.cc:399] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41e55c8a3a40e3bf81f862aaadfd20, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0302 15:31:27.456797 28468 consensus_queue.cc:127] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:31:27.456871 28469 ts_tablet_manager.cc:339] Time spent starting tablet ad1251b8988446ffa0348b542d353bd4: real 0.001s user 0.001s sys 0.000s I0302 15:31:27.456941 28468 ts_tablet_manager.cc:339] Time spent starting tablet ad1251b8988446ffa0348b542d353bd4: real 0.004s user 0.002s sys 0.001s I0302 15:31:27.457264 28480 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: No bootstrap required, opened a new log I0302 15:31:27.457315 28486 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: No bootstrap required, opened a new log I0302 15:31:27.457355 28480 ts_tablet_manager.cc:319] Time spent tablet 36005aaac18b4c70b2fc03d1382ca7c3 bootstrap: real 0.007s user 0.001s sys 0.003s I0302 15:31:27.457356 28486 ts_tablet_manager.cc:319] Time spent tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 bootstrap: real 0.003s user 0.001s sys 0.001s I0302 15:31:27.457471 28485 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: No bootstrap required, opened a new log I0302 15:31:27.457541 28485 ts_tablet_manager.cc:319] Time spent tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 bootstrap: real 0.004s user 0.003s sys 0.000s I0302 15:31:27.458667 28485 raft_consensus.cc:194] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:31:27.458717 28485 raft_consensus.cc:211] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:31:27.458777 28485 raft_consensus.cc:399] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41e55c8a3a40e3bf81f862aaadfd20, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0302 15:31:27.458822 28485 consensus_queue.cc:127] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:31:27.458946 28485 ts_tablet_manager.cc:339] Time spent starting tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: real 0.001s user 0.001s sys 0.000s I0302 15:31:27.459573 28486 raft_consensus.cc:194] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:31:27.459597 28486 raft_consensus.cc:211] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:31:27.459627 28486 raft_consensus.cc:399] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0302 15:31:27.459652 28486 consensus_queue.cc:127] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:31:27.459754 28486 ts_tablet_manager.cc:339] Time spent starting tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: real 0.002s user 0.002s sys 0.000s I0302 15:31:27.459980 28480 raft_consensus.cc:194] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:31:27.460023 28480 raft_consensus.cc:211] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:31:27.460067 28480 raft_consensus.cc:399] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0302 15:31:27.460099 28480 consensus_queue.cc:127] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:31:27.460191 28480 ts_tablet_manager.cc:339] Time spent starting tablet 36005aaac18b4c70b2fc03d1382ca7c3: real 0.003s user 0.001s sys 0.001s I0302 15:31:28.276185 28280 external_mini_cluster.cc:269] 3 TS(s) registered with Master W0302 15:31:28.279181 28280 ts_itest-base.h:183] Couldn't find the leader and/or replicas. Location: tablet_id: "36005aaac18b4c70b2fc03d1382ca7c3" start_key: "" end_key: "UUUUUUUU" replicas { ts_info { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" rpc_addresses { host: "127.0.0.1" port: 7050 } } role: CANDIDATE } stale: false I0302 15:31:28.999758 28479 raft_consensus.cc:327] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Failure of peer election-timer detected. Triggering leader election I0302 15:31:29.000777 28479 raft_consensus.cc:1299] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:31:29.000843 28479 raft_consensus.cc:294] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Starting election with quorum: local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:31:29.001823 28479 leader_election.cc:187] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 1 election: Requesting vote from peer 892c1da145ed4847b1dfd57983516d8f I0302 15:31:29.001869 28479 leader_election.cc:187] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 1 election: Requesting vote from peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:31:29.002351 28487 raft_consensus.cc:327] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Failure of peer election-timer detected. Triggering leader election I0302 15:31:29.003223 28395 raft_consensus.cc:1336] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Advancing to term 1 I0302 15:31:29.003373 28487 raft_consensus.cc:1299] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:31:29.003429 28487 raft_consensus.cc:294] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Starting election with quorum: local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:31:29.004201 28395 raft_consensus.cc:1299] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:31:29.004209 28351 raft_consensus.cc:1336] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Advancing to term 1 I0302 15:31:29.004513 28487 leader_election.cc:187] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 1 election: Requesting vote from peer 3e41e55c8a3a40e3bf81f862aaadfd20 I0302 15:31:29.004585 28487 leader_election.cc:187] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 1 election: Requesting vote from peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:31:29.004885 28395 raft_consensus.cc:1136] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41e55c8a3a40e3bf81f862aaadfd20 in term 1. I0302 15:31:29.005035 28416 leader_election.cc:308] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 1 election: Vote granted by peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:31:29.005053 28416 leader_election.cc:281] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0302 15:31:29.005080 28416 raft_consensus.cc:1299] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:31:29.005096 28416 raft_consensus.cc:1237] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Leader election won for term 1 I0302 15:31:29.005146 28416 raft_consensus.cc:361] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: Becoming Leader. State: Replica: 3e41e55c8a3a40e3bf81f862aaadfd20, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0302 15:31:29.005170 28416 consensus_queue.cc:119] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER I0302 15:31:29.005177 28351 raft_consensus.cc:1299] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:31:29.006381 28396 raft_consensus.cc:1336] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Advancing to term 1 W0302 15:31:29.006425 28512 raft_consensus_state.cc:477] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0302 15:31:29.006482 28440 raft_consensus.cc:1336] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Advancing to term 1 I0302 15:31:29.006556 28351 raft_consensus.cc:1136] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41e55c8a3a40e3bf81f862aaadfd20 in term 1. I0302 15:31:29.007118 28396 raft_consensus.cc:1299] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:31:29.007285 28440 raft_consensus.cc:1299] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:31:29.007609 28416 leader_election.cc:308] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 1 election: Vote granted by peer 892c1da145ed4847b1dfd57983516d8f I0302 15:31:29.007935 28396 raft_consensus.cc:1136] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 892c1da145ed4847b1dfd57983516d8f in term 1. I0302 15:31:29.008010 28440 raft_consensus.cc:1136] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 892c1da145ed4847b1dfd57983516d8f in term 1. I0302 15:31:29.008066 28327 leader_election.cc:308] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 1 election: Vote granted by peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:31:29.008086 28327 leader_election.cc:281] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0302 15:31:29.008110 28327 raft_consensus.cc:1299] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:31:29.008124 28327 raft_consensus.cc:1237] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Leader election won for term 1 I0302 15:31:29.008177 28327 raft_consensus.cc:361] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Becoming Leader. State: Replica: 892c1da145ed4847b1dfd57983516d8f, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0302 15:31:29.008201 28327 consensus_queue.cc:119] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER I0302 15:31:29.008755 28327 leader_election.cc:308] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 1 election: Vote granted by peer 3e41e55c8a3a40e3bf81f862aaadfd20 W0302 15:31:29.008997 28517 raft_consensus_state.cc:477] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0302 15:31:29.100509 28482 raft_consensus.cc:327] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Failure of peer election-timer detected. Triggering leader election I0302 15:31:29.101663 28482 raft_consensus.cc:1299] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:31:29.101724 28482 raft_consensus.cc:294] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Starting election with quorum: local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:31:29.102851 28482 leader_election.cc:187] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 1 election: Requesting vote from peer 892c1da145ed4847b1dfd57983516d8f I0302 15:31:29.102902 28482 leader_election.cc:187] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 1 election: Requesting vote from peer 3e41e55c8a3a40e3bf81f862aaadfd20 I0302 15:31:29.103734 28352 raft_consensus.cc:1336] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Advancing to term 1 I0302 15:31:29.103742 28441 raft_consensus.cc:1336] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Advancing to term 1 I0302 15:31:29.104652 28441 raft_consensus.cc:1299] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:31:29.104662 28352 raft_consensus.cc:1299] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:31:29.105469 28352 raft_consensus.cc:1136] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5748afe5294c41b89cbb67f8edbee2a1 in term 1. I0302 15:31:29.105602 28441 raft_consensus.cc:1136] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5748afe5294c41b89cbb67f8edbee2a1 in term 1. I0302 15:31:29.105623 28371 leader_election.cc:308] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 1 election: Vote granted by peer 892c1da145ed4847b1dfd57983516d8f I0302 15:31:29.105639 28371 leader_election.cc:281] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0302 15:31:29.105661 28371 raft_consensus.cc:1299] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:31:29.105677 28371 raft_consensus.cc:1237] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Leader election won for term 1 I0302 15:31:29.105732 28371 raft_consensus.cc:361] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: Becoming Leader. State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I0302 15:31:29.105757 28371 consensus_queue.cc:119] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER I0302 15:31:29.106487 28371 leader_election.cc:308] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 1 election: Vote granted by peer 3e41e55c8a3a40e3bf81f862aaadfd20 W0302 15:31:29.106904 28523 raft_consensus_state.cc:477] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0302 15:31:29.280908 28280 linked_list-test-util.h:402] Written 0 rows in chain ------------------------------------------------------------ Histogram for latency of insert operations (microseconds) Note: each insert is a batch of 50 rows. ------------------------------------------------------------ Count: 0 Mean: 0 Percentiles: 0% (min) = 0 25% = 0 50% (med) = 0 75% = 0 95% = 0 99% = 0 99.9% = 0 99.99% = 0 100% (max) = 0 I0302 15:31:29.283442 28547 linked_list-test-util.h:277] Curl thread will poll the following URLs every 1000 ms: I0302 15:31:29.283478 28547 linked_list-test-util.h:280] http://127.0.0.1:41309/jsonmetricz I0302 15:31:29.283504 28547 linked_list-test-util.h:280] http://127.0.0.1:41309/masterz I0302 15:31:29.283526 28547 linked_list-test-util.h:280] http://127.0.0.1:41309/tablez I0302 15:31:29.283563 28547 linked_list-test-util.h:280] http://127.0.0.1:41309/tablet-servers I0302 15:31:29.283588 28547 linked_list-test-util.h:280] http://127.0.0.1:40132/jsonmetricz I0302 15:31:29.283654 28547 linked_list-test-util.h:280] http://127.0.0.1:40132/tablets I0302 15:31:29.283680 28547 linked_list-test-util.h:280] http://127.0.0.1:55689/jsonmetricz I0302 15:31:29.283704 28547 linked_list-test-util.h:280] http://127.0.0.1:55689/tablets I0302 15:31:29.283730 28547 linked_list-test-util.h:280] http://127.0.0.1:43948/jsonmetricz I0302 15:31:29.283758 28547 linked_list-test-util.h:280] http://127.0.0.1:43948/tablets I0302 15:31:29.283782 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/jsonmetricz W0302 15:31:29.288023 28517 raft_consensus_state.cc:477] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0302 15:31:29.288122 28397 raft_consensus.cc:642] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Refusing update from remote peer 892c1da145ed4847b1dfd57983516d8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. I0302 15:31:29.288166 28442 raft_consensus.cc:642] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Refusing update from remote peer 892c1da145ed4847b1dfd57983516d8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. I0302 15:31:29.288270 28327 consensus_queue.cc:428] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Connected to new peer: Peer: 5748afe5294c41b89cbb67f8edbee2a1, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0302 15:31:29.288362 28327 consensus_queue.cc:428] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Connected to new peer: Peer: 3e41e55c8a3a40e3bf81f862aaadfd20, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0302 15:31:29.290452 28517 raft_consensus_state.cc:470] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Advanced the committed_index across terms. Last committed operation was: term: 0 index: 0 New committed index is: term: 1 index: 2 I0302 15:31:29.290560 28476 change_config_transaction.cc:135] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } W0302 15:31:29.295361 28523 raft_consensus_state.cc:477] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0302 15:31:29.295444 28444 raft_consensus.cc:642] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Refusing update from remote peer 5748afe5294c41b89cbb67f8edbee2a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. I0302 15:31:29.295482 28353 raft_consensus.cc:642] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Refusing update from remote peer 5748afe5294c41b89cbb67f8edbee2a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. I0302 15:31:29.295583 28371 consensus_queue.cc:428] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: Connected to new peer: Peer: 3e41e55c8a3a40e3bf81f862aaadfd20, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0302 15:31:29.295670 28371 consensus_queue.cc:428] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: Connected to new peer: Peer: 892c1da145ed4847b1dfd57983516d8f, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0302 15:31:29.297790 28523 raft_consensus_state.cc:470] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: Advanced the committed_index across terms. Last committed operation was: term: 0 index: 0 New committed index is: term: 1 index: 2 I0302 15:31:29.298132 28478 change_config_transaction.cc:135] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: LEADER last_known_addr { host: "127.0.0.1" port: 7051 } } W0302 15:31:29.302454 28512 raft_consensus_state.cc:477] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 0 index: 0 New majority replicated is: term: 0 index: 0. Current term is: 1 I0302 15:31:29.302541 28355 raft_consensus.cc:642] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Refusing update from remote peer 3e41e55c8a3a40e3bf81f862aaadfd20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. I0302 15:31:29.302552 28399 raft_consensus.cc:642] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Refusing update from remote peer 3e41e55c8a3a40e3bf81f862aaadfd20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. I0302 15:31:29.302688 28416 consensus_queue.cc:428] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: Connected to new peer: Peer: 5748afe5294c41b89cbb67f8edbee2a1, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0302 15:31:29.302747 28416 consensus_queue.cc:428] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: Connected to new peer: Peer: 892c1da145ed4847b1dfd57983516d8f, New: false, Last received: 0.0, Last sent , Last known committed idx: 0 Last exchange result: ERROR I0302 15:31:29.304941 28512 raft_consensus_state.cc:470] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: Advanced the committed_index across terms. Last committed operation was: term: 0 index: 0 New committed index is: term: 1 index: 2 I0302 15:31:29.305137 28473 change_config_transaction.cc:135] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:31:29.308176 28484 change_config_transaction.cc:135] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: LEADER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:31:29.308907 28495 change_config_transaction.cc:135] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:31:29.309840 28496 change_config_transaction.cc:135] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:31:29.310127 28489 change_config_transaction.cc:135] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: LEADER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:31:29.309844 28497 change_config_transaction.cc:135] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:31:29.310318 28475 change_config_transaction.cc:135] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f: Configuration changed Changed from: opid_index: -1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:31:29.337185 28296 catalog_manager.cc:1283] Tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 reported quorum change. New quorum: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:31:29.338639 28296 catalog_manager.cc:1283] Tablet: 36005aaac18b4c70b2fc03d1382ca7c3 reported quorum change. New quorum: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:31:29.339076 28296 catalog_manager.cc:1283] Tablet: ad1251b8988446ffa0348b542d353bd4 reported quorum change. New quorum: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: LEADER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:31:30.283942 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/masterz I0302 15:31:30.774531 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:30.774572 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:30.774593 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:30.774611 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:30.774700 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 1978 or (T in {1978})}] I0302 15:31:30.775742 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:30.776007 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:30.776450 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:30.777456 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:30.838527 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:30.838577 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:30.838616 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:30.838644 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:30.838691 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 2032 or (T in {2032})}] I0302 15:31:30.839843 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:30.840324 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:30.840644 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:30.840939 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:30.859491 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea6b8846f178ea40698190ebc28feb9efd I0302 15:31:30.859624 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:30.861089 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:30.861176 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2048 or (T in {2048,2052})}] I0302 15:31:30.877578 28324 tablet.cc:1059] Flush successful on 10930 rows (279026 bytes) I0302 15:31:30.877924 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.105s user 0.012s sys 0.008s I0302 15:31:30.891391 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be485d2345bf784faf8de82e36d7830f18 I0302 15:31:30.891621 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:30.891659 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:30.891680 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:30.891700 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:30.891731 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 2081 or (T in {2081})}] I0302 15:31:30.891876 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:30.893055 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:30.893381 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:30.893730 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:30.894071 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:30.894842 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:30.894919 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2079 or (T in {2079,2082})}] I0302 15:31:30.902294 28368 tablet.cc:1059] Flush successful on 11240 rows (286466 bytes) I0302 15:31:30.903647 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.068s user 0.016s sys 0.006s I0302 15:31:30.961657 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6f7db13a8c1d84d59aae5a1f381a3a9a0 I0302 15:31:30.961793 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:30.961911 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:30.961928 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2136 or (T in {2136})}] I0302 15:31:30.972528 28413 tablet.cc:1059] Flush successful on 11506 rows (292850 bytes) I0302 15:31:30.972785 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.082s user 0.013s sys 0.007s I0302 15:31:31.023440 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:31.023471 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:31.023488 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:31.023509 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:31.023530 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 2203 or (T in {2203})}] I0302 15:31:31.024006 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:31.024353 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:31.024636 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:31.024901 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:31.064770 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deaf87fe5a6ecaf467aacbaad00a8912aac I0302 15:31:31.064975 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:31.065173 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:31.065208 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2240 or (T in {2240,2243})}] I0302 15:31:31.072263 28324 tablet.cc:1059] Flush successful on 12413 rows (314618 bytes) I0302 15:31:31.072425 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.049s user 0.013s sys 0.005s I0302 15:31:31.088471 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:31.088500 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:31.088523 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:31.088547 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:31.088567 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 2269 or (T in {2269})}] I0302 15:31:31.088883 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:31.089071 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:31.089318 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:31.089620 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:31.142030 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:31.142055 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:31.142065 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:31.142072 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:31.142088 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 2321 or (T in {2321})}] I0302 15:31:31.142516 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:31.142777 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:31.143311 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:31.143615 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:31.149919 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be3c0442ba74ec4de5958c685f1634ac51 I0302 15:31:31.150002 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:31.151900 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:31.151948 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2322 or (T in {2322,2328,2331})}] I0302 15:31:31.159842 28368 tablet.cc:1059] Flush successful on 12778 rows (323378 bytes) I0302 15:31:31.159961 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.074s user 0.011s sys 0.005s I0302 15:31:31.194635 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b63e021efe7fbe4906b6dcf56f19094b87 I0302 15:31:31.194696 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:31.196619 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:31.196688 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2379 or (T in {2379,2383})}] I0302 15:31:31.204107 28413 tablet.cc:1059] Flush successful on 13096 rows (331010 bytes) I0302 15:31:31.204217 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.063s user 0.011s sys 0.006s I0302 15:31:31.274186 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:31.274215 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:31.274235 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:31.274246 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:31.274268 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 2487 or (T in {2487})}] I0302 15:31:31.274560 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:31.274747 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:31.274941 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:31.275130 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:31.284101 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/tablez I0302 15:31:31.336066 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:31.336086 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:31.336096 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:31.336107 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:31.336122 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 2545 or (T in {2545})}] I0302 15:31:31.336431 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:31.337092 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:31.337290 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:31.337491 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:31.356669 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea43ae79a925f146cab3c55e0314f6d7df I0302 15:31:31.356734 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:31.358886 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:31.358907 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2567 or (T in {2567,2570})}] I0302 15:31:31.372819 28324 tablet.cc:1059] Flush successful on 13885 rows (354066 bytes) I0302 15:31:31.372930 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.099s user 0.008s sys 0.008s I0302 15:31:31.390733 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be0b37b58da9114b96bfcc5fd8e5a931f9 I0302 15:31:31.390815 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:31.390897 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:31.390939 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2600 or (T in {2600})}] I0302 15:31:31.392437 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:31.392468 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:31.392494 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:31.392518 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:31.392554 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 2602 or (T in {2602})}] I0302 15:31:31.393034 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:31.393298 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:31.393563 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:31.394361 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:31.407388 28368 tablet.cc:1059] Flush successful on 14247 rows (362754 bytes) I0302 15:31:31.407582 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.072s user 0.009s sys 0.008s I0302 15:31:31.485184 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b67f4789f74e7e46468b8aa1021941f368 I0302 15:31:31.485270 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:31.487829 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:31.487867 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 2684 or (T in {2684,2686,2690})}] I0302 15:31:31.495802 28413 tablet.cc:1059] Flush successful on 14589 rows (370962 bytes) I0302 15:31:31.495909 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.105s user 0.013s sys 0.005s I0302 15:31:32.284258 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/tablet-servers I0302 15:31:32.526110 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:32.526149 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:32.526175 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:32.526203 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:32.526265 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 3965 or (T in {3965})}] I0302 15:31:32.526733 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:32.526954 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:32.527164 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:32.527364 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:32.596283 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:32.596334 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:32.596354 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:32.596367 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:32.596408 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 4022 or (T in {4022})}] I0302 15:31:32.596743 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:32.596962 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:32.597164 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:32.597457 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:32.603256 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea2f4fc90dda1f4776bbabee2d37cf0843 I0302 15:31:32.603354 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:32.605353 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:32.605391 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 4029 or (T in {4029,4031})}] I0302 15:31:32.609369 28324 tablet.cc:1059] Flush successful on 11068 rows (282338 bytes) I0302 15:31:32.609581 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.085s user 0.011s sys 0.005s I0302 15:31:32.642447 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:32.642480 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:32.642500 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:32.642518 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:32.642562 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 4066 or (T in {4066})}] I0302 15:31:32.643034 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:32.643331 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:32.643651 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:32.646373 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:32.657650 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bea316ee07be204bc88b0c1ce581de71bf I0302 15:31:32.657753 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:32.659469 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:32.659520 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 4078 or (T in {4078,4081})}] I0302 15:31:32.668248 28368 tablet.cc:1059] Flush successful on 11094 rows (282962 bytes) I0302 15:31:32.668418 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.082s user 0.011s sys 0.005s I0302 15:31:32.724447 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6bd56a35195194fa28ffeac5593654e4a I0302 15:31:32.724565 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:32.724642 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:32.724675 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 4138 or (T in {4138})}] I0302 15:31:32.729959 28413 tablet.cc:1059] Flush successful on 11092 rows (282914 bytes) I0302 15:31:32.730187 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.088s user 0.012s sys 0.005s I0302 15:31:32.775562 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:32.775596 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:32.775615 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:32.775624 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:32.775636 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 4197 or (T in {4197})}] I0302 15:31:32.775955 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:32.776151 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:32.776343 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:32.776538 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:32.800407 28476 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:32.801261 28495 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:32.801437 28497 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:32.802161 28476 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 I0302 15:31:32.803971 28497 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 I0302 15:31:32.804141 28495 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 I0302 15:31:32.819381 28478 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:32.819676 28484 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:32.819818 28489 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:32.821007 28489 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 I0302 15:31:32.821136 28484 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 I0302 15:31:32.821524 28478 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 I0302 15:31:32.831157 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deaa320881bedd349cdbc71c3e3b59140df I0302 15:31:32.831236 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:32.831310 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:32.831342 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 4254 or (T in {4254})}] I0302 15:31:32.831655 28473 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:32.832077 28496 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:32.832185 28475 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:32.832679 28496 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 I0302 15:31:32.833365 28473 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 I0302 15:31:32.835252 28475 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 I0302 15:31:32.836498 28324 tablet.cc:1059] Flush successful on 11205 rows (285626 bytes) I0302 15:31:32.836963 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.063s user 0.013s sys 0.002s I0302 15:31:32.838248 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:32.838269 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:32.838294 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:32.838307 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:32.838326 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 4258 or (T in {4258})}] I0302 15:31:32.838641 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:32.838881 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:32.839130 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:32.839383 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:32.893342 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:32.893373 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:32.893388 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:32.893404 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:32.893431 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 4307 or (T in {4307})}] I0302 15:31:32.893843 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:32.894105 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:32.894372 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:32.894634 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:32.922693 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be20c52d4efe744f9d9929864556a15ac5 I0302 15:31:32.922796 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:32.924846 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:32.924883 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 4333 or (T in {4333,4336})}] I0302 15:31:32.931035 28368 tablet.cc:1059] Flush successful on 11177 rows (284954 bytes) I0302 15:31:32.931149 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.094s user 0.009s sys 0.008s I0302 15:31:32.951130 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6a193ea7fa0924f788d8a36e3d0888013 I0302 15:31:32.951211 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:32.953671 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:32.953719 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 4364 or (T in {4364,4367})}] I0302 15:31:32.957356 28413 tablet.cc:1059] Flush successful on 11127 rows (283754 bytes) I0302 15:31:32.957630 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.065s user 0.010s sys 0.008s I0302 15:31:33.025349 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:33.025380 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:33.025394 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:33.025411 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:33.025440 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 4455 or (T in {4455})}] I0302 15:31:33.025873 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:33.026098 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:33.026312 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:33.026520 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:33.087077 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:33.087097 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:33.087106 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:33.087116 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:33.087127 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 4522 or (T in {4522})}] I0302 15:31:33.088785 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:33.088994 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:33.092017 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:33.092206 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:33.117449 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea03d6c9b566794225be96bff8dbae93fd I0302 15:31:33.117616 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:33.119005 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:33.119213 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 4545 or (T in {4545,4548})}] I0302 15:31:33.131837 28324 tablet.cc:1059] Flush successful on 10922 rows (278834 bytes) I0302 15:31:33.132040 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.108s user 0.008s sys 0.006s I0302 15:31:33.145407 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:33.145437 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:33.145455 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:33.145489 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:33.145522 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 4572 or (T in {4572})}] I0302 15:31:33.145862 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:33.146042 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:33.146219 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:33.146383 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:33.176025 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be4601b62dfa6044d9bf9bd47a6224015c I0302 15:31:33.176089 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:33.176161 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:33.176187 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 4603 or (T in {4603})}] I0302 15:31:33.181263 28368 tablet.cc:1059] Flush successful on 10953 rows (279578 bytes) I0302 15:31:33.181674 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.095s user 0.010s sys 0.005s I0302 15:31:33.215085 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b67eeefdbf59e446a1b830f0c3eab1a990 I0302 15:31:33.215169 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:33.216878 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:33.216933 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 4638 or (T in {4638,4642})}] I0302 15:31:33.225430 28413 tablet.cc:1059] Flush successful on 10878 rows (277778 bytes) I0302 15:31:33.225538 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.083s user 0.010s sys 0.006s I0302 15:31:33.284421 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:40132/jsonmetricz I0302 15:31:34.277413 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:34.277459 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:34.277478 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:34.277495 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:34.277525 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 5951 or (T in {5951})}] I0302 15:31:34.278014 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:34.278311 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:34.278623 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:34.278836 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:34.284621 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:40132/tablets I0302 15:31:34.319823 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea3af89f79d6fe48f0b72fa94e748d9e8c I0302 15:31:34.319885 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:34.320616 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:34.320847 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 5997 or (T in {5997,6000})}] I0302 15:31:34.325525 28324 tablet.cc:1059] Flush successful on 11104 rows (283202 bytes) I0302 15:31:34.325786 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.051s user 0.011s sys 0.006s I0302 15:31:34.340242 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:34.340270 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:34.340287 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:34.340301 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:34.340314 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6018 or (T in {6018})}] I0302 15:31:34.340615 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:34.340833 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:34.341117 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:34.341358 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:34.393630 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:34.393658 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:34.393674 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:34.393687 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:34.393707 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6069 or (T in {6069})}] I0302 15:31:34.394034 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:34.394227 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:34.394428 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:34.394718 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:34.433866 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be25fc76bf9527474582bfa3167bcee83e I0302 15:31:34.433940 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:34.435392 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:34.435446 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 6100 or (T in {6100,6102})}] I0302 15:31:34.441794 28368 tablet.cc:1059] Flush successful on 11165 rows (284666 bytes) I0302 15:31:34.441928 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.104s user 0.012s sys 0.005s I0302 15:31:34.459843 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6ea161a61e6e147cdab79f269573f6d33 I0302 15:31:34.460266 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:34.460952 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:34.461004 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 6129 or (T in {6129,6132})}] I0302 15:31:34.465786 28413 tablet.cc:1059] Flush successful on 11198 rows (285458 bytes) I0302 15:31:34.466001 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.073s user 0.010s sys 0.007s I0302 15:31:34.525854 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:34.525882 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:34.525897 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:34.526042 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:34.526062 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6213 or (T in {6213})}] I0302 15:31:34.526345 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:34.526521 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:34.526825 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:34.527122 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:34.580735 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deaf5957f5894f6430db09fa55a827b8890 I0302 15:31:34.580829 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:34.581344 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:34.581364 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 6268 or (T in {6268,6271})}] I0302 15:31:34.587962 28324 tablet.cc:1059] Flush successful on 11341 rows (288890 bytes) I0302 15:31:34.588137 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.063s user 0.012s sys 0.004s I0302 15:31:34.589949 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:34.590006 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:34.590029 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:34.590044 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:34.590065 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6270 or (T in {6270})}] I0302 15:31:34.590443 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:34.590638 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:34.590834 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:34.591033 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:34.644482 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:34.644503 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:34.644527 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:34.644536 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:34.644556 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6334 or (T in {6334})}] I0302 15:31:34.644840 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:34.645025 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:34.645211 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:34.645407 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:34.678258 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bebccbe3c55ca542b7be78e3f442add1fc I0302 15:31:34.678330 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:34.680239 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:34.680301 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 6361 or (T in {6361,6364})}] I0302 15:31:34.687089 28368 tablet.cc:1059] Flush successful on 11333 rows (288698 bytes) I0302 15:31:34.687213 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.099s user 0.012s sys 0.005s I0302 15:31:34.700784 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b649c335223aa94ef4ba12016fd74bf2f1 I0302 15:31:34.700984 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:34.703784 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:34.703831 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 6385 or (T in {6385,6391,6388})}] I0302 15:31:34.709309 28413 tablet.cc:1059] Flush successful on 11414 rows (290642 bytes) I0302 15:31:34.709427 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.066s user 0.013s sys 0.003s I0302 15:31:34.776691 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:34.776722 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:34.776738 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:34.776756 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:34.776832 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6485 or (T in {6485})}] I0302 15:31:34.777293 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:34.777492 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:34.777686 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:34.777869 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:34.840479 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:34.840514 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:34.840536 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:34.840553 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:34.840574 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6533 or (T in {6533})}] I0302 15:31:34.840945 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:34.841137 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:34.841325 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:34.841558 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:34.858551 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea0522c498213446bab9e8caccf8b09098 I0302 15:31:34.858651 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:34.860296 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:34.860353 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 6557 or (T in {6557,6560})}] I0302 15:31:34.873446 28324 tablet.cc:1059] Flush successful on 11188 rows (285218 bytes) I0302 15:31:34.873749 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.098s user 0.011s sys 0.005s I0302 15:31:34.895150 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:34.895179 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:34.895202 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:34.895236 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:34.895259 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6588 or (T in {6588})}] I0302 15:31:34.895972 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:34.896170 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:34.896358 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:34.896589 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:34.905164 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be1fdd2e9c15854d7d9f7e53f2f92cd9a6 I0302 15:31:34.905256 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:34.905381 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:34.905413 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 6597 or (T in {6597})}] I0302 15:31:34.910310 28368 tablet.cc:1059] Flush successful on 11096 rows (283010 bytes) I0302 15:31:34.910415 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.072s user 0.011s sys 0.004s I0302 15:31:34.976872 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b67fbb3dde9d4741f8a5ceaae2c25b216b I0302 15:31:34.976945 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:34.978632 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:34.978679 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 6668 or (T in {6668,6671})}] I0302 15:31:34.990334 28413 tablet.cc:1059] Flush successful on 11105 rows (283226 bytes) I0302 15:31:34.990483 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.097s user 0.013s sys 0.003s I0302 15:31:35.284788 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:55689/jsonmetricz I0302 15:31:36.027354 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:36.027379 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:36.027392 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:36.027402 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:36.027415 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 7844 or (T in {7844})}] I0302 15:31:36.027792 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:36.028013 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:36.028237 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:36.028534 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:36.080202 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deaa280a984c27f486d9d84f11956747540 I0302 15:31:36.080271 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:36.081861 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:36.081918 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 7890 or (T in {7890,7895})}] I0302 15:31:36.085441 28324 tablet.cc:1059] Flush successful on 10825 rows (276506 bytes) I0302 15:31:36.085610 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.059s user 0.012s sys 0.005s I0302 15:31:36.091313 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:36.091339 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:36.091357 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:36.091377 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:36.091403 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 7898 or (T in {7898})}] I0302 15:31:36.091755 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:36.092111 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:36.092409 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:36.092705 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:36.156607 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be53844f5db07e41f7b10f699d6ff9c972 I0302 15:31:36.156694 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:36.158402 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:36.158467 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 7961 or (T in {7961,7965})}] I0302 15:31:36.162940 28368 tablet.cc:1059] Flush successful on 10739 rows (274442 bytes) I0302 15:31:36.163061 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.074s user 0.010s sys 0.005s I0302 15:31:36.285022 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:55689/tablets I0302 15:31:36.394345 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:36.394373 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:36.394387 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:36.394399 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:36.394419 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 8225 or (T in {8225})}] I0302 15:31:36.394829 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:36.395102 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:36.395334 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:36.395553 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:36.441282 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6cca6d3d2440e44e888838e0510612dbb I0302 15:31:36.441360 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:36.441454 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:36.441501 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 8274 or (T in {8274})}] I0302 15:31:36.447175 28413 tablet.cc:1059] Flush successful on 12244 rows (310562 bytes) I0302 15:31:36.447370 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.053s user 0.011s sys 0.006s I0302 15:31:36.527401 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:36.527427 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:36.527442 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:36.527453 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:36.527468 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 8372 or (T in {8372})}] I0302 15:31:36.527802 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:36.527997 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:36.528182 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:36.528364 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:36.592834 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:36.592866 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:36.592883 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:36.592901 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:36.592921 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 8425 or (T in {8425})}] I0302 15:31:36.593619 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:36.594184 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:36.594521 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:36.595520 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:36.605600 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deaac8ae0aaa13c42818ab4fe85d652e60e I0302 15:31:36.605669 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:36.605742 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:36.605774 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 8439 or (T in {8439})}] I0302 15:31:36.609789 28324 tablet.cc:1059] Flush successful on 12105 rows (307226 bytes) I0302 15:31:36.610414 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.084s user 0.011s sys 0.005s I0302 15:31:36.612226 28476 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:36.613281 28497 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:36.613749 28495 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:36.614250 28495 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000003 I0302 15:31:36.614439 28476 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000003 I0302 15:31:36.614532 28497 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000003 I0302 15:31:36.630265 28473 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:36.630492 28496 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:36.630705 28475 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:36.631634 28496 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000003 I0302 15:31:36.632061 28473 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000003 I0302 15:31:36.635282 28475 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000003 I0302 15:31:36.644392 28413 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:36.644415 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000001 (GCed ops < 2109) I0302 15:31:36.644954 28413 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.001s I0302 15:31:36.670073 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bec95985cbf5054d39be5876b1fd28d76a I0302 15:31:36.670181 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:36.671239 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:36.671282 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 8495 or (T in {8495,8498})}] I0302 15:31:36.674033 28368 tablet.cc:1059] Flush successful on 12084 rows (306722 bytes) I0302 15:31:36.674079 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.085s user 0.013s sys 0.005s I0302 15:31:36.679569 28478 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:36.679991 28484 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:36.680281 28489 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:36.681051 28489 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000003 I0302 15:31:36.681493 28484 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000003 I0302 15:31:36.681704 28478 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000003 I0302 15:31:36.776662 28324 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:36.776686 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000001 (GCed ops < 2616) I0302 15:31:36.777326 28324 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.000s I0302 15:31:36.839133 28368 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:36.839164 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000001 (GCed ops < 2635) I0302 15:31:36.839983 28368 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.001s I0302 15:31:36.894480 28413 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:36.894502 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000001 (GCed ops < 2745) I0302 15:31:36.895007 28413 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.000s I0302 15:31:37.026898 28324 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:37.026926 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000001 (GCed ops < 2162) I0302 15:31:37.027518 28324 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.001s I0302 15:31:37.089339 28368 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:37.089371 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000001 (GCed ops < 2181) I0302 15:31:37.090028 28368 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.001s I0302 15:31:37.144604 28413 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:37.144634 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000001 (GCed ops < 2198) I0302 15:31:37.145261 28413 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.000s I0302 15:31:37.277639 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:37.277673 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:37.277703 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:37.277732 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:37.277757 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 9184 or (T in {9184})}] I0302 15:31:37.278290 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:37.278565 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:37.278828 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:37.279062 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:37.285179 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:43948/jsonmetricz I0302 15:31:37.333933 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deae0a9360a2b1c4298bbcabefea521f1a4 I0302 15:31:37.334162 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:37.336087 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:37.336140 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 9235 or (T in {9235,9238})}] I0302 15:31:37.339432 28368 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:37.339464 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000001 (GCed ops < 2808) I0302 15:31:37.340633 28368 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.001s I0302 15:31:37.341215 28324 tablet.cc:1059] Flush successful on 15100 rows (383226 bytes) I0302 15:31:37.341367 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.064s user 0.018s sys 0.004s I0302 15:31:37.398437 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:37.398470 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:37.398488 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:37.398506 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:37.398530 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 9300 or (T in {9300})}] I0302 15:31:37.398934 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:37.399255 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:37.399520 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:37.399797 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:37.472671 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b675870373abd34387b9765d35f067f6ae I0302 15:31:37.472790 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:37.473414 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:37.473461 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 9369 or (T in {9369,9373})}] I0302 15:31:37.478659 28413 tablet.cc:1059] Flush successful on 16649 rows (420402 bytes) I0302 15:31:37.478757 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.084s user 0.020s sys 0.005s I0302 15:31:37.527374 28324 tablet.cc:1081] Compaction: stage 1 complete, picked 4 rowsets to compact I0302 15:31:37.527405 28324 compaction.cc:552] Selected 4 rowsets to compact: I0302 15:31:37.527425 28324 compaction.cc:555] RowSet(0)(current size on disk: ~333629 bytes) I0302 15:31:37.527441 28324 compaction.cc:555] RowSet(1)(current size on disk: ~262517 bytes) I0302 15:31:37.527468 28324 compaction.cc:555] RowSet(2)(current size on disk: ~268901 bytes) I0302 15:31:37.527485 28324 compaction.cc:555] RowSet(3)(current size on disk: ~362789 bytes) I0302 15:31:37.527518 28324 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 9430 or (T in {9430})}] I0302 15:31:37.528157 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:37.528545 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:37.528828 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:37.529079 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:37.590030 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 4 rowsets to compact I0302 15:31:37.590075 28368 compaction.cc:552] Selected 4 rowsets to compact: I0302 15:31:37.590096 28368 compaction.cc:555] RowSet(0)(current size on disk: ~307061 bytes) I0302 15:31:37.590112 28368 compaction.cc:555] RowSet(1)(current size on disk: ~268637 bytes) I0302 15:31:37.590131 28368 compaction.cc:555] RowSet(2)(current size on disk: ~272381 bytes) I0302 15:31:37.590144 28368 compaction.cc:555] RowSet(3)(current size on disk: ~290405 bytes) I0302 15:31:37.590191 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 9478 or (T in {9478})}] I0302 15:31:37.591572 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:37.592521 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:37.592911 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:37.593134 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:37.645140 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 4 rowsets to compact I0302 15:31:37.645171 28413 compaction.cc:552] Selected 4 rowsets to compact: I0302 15:31:37.645190 28413 compaction.cc:555] RowSet(0)(current size on disk: ~276533 bytes) I0302 15:31:37.645208 28413 compaction.cc:555] RowSet(1)(current size on disk: ~266597 bytes) I0302 15:31:37.645234 28413 compaction.cc:555] RowSet(2)(current size on disk: ~269141 bytes) I0302 15:31:37.645256 28413 compaction.cc:555] RowSet(3)(current size on disk: ~294245 bytes) I0302 15:31:37.645290 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 9527 or (T in {9527})}] I0302 15:31:37.646630 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:37.647402 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:37.647627 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:37.648098 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:37.662583 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea99b3a4dd13d04715acae8e47fdf9c0b2 I0302 15:31:37.662691 28324 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:37.666002 28324 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:37.666038 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 9544 or (T in {9544,9548,9551})}] I0302 15:31:37.698421 28324 tablet.cc:1059] Compaction successful on 51095 rows (1288394 bytes) I0302 15:31:37.702615 28324 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.175s user 0.057s sys 0.010s I0302 15:31:37.777163 28324 tablet.cc:1081] Compaction: stage 1 complete, picked 4 rowsets to compact I0302 15:31:37.777199 28324 compaction.cc:552] Selected 4 rowsets to compact: I0302 15:31:37.777225 28324 compaction.cc:555] RowSet(0)(current size on disk: ~298301 bytes) I0302 15:31:37.777250 28324 compaction.cc:555] RowSet(1)(current size on disk: ~269309 bytes) I0302 15:31:37.777272 28324 compaction.cc:555] RowSet(2)(current size on disk: ~272573 bytes) I0302 15:31:37.777303 28324 compaction.cc:555] RowSet(3)(current size on disk: ~290909 bytes) I0302 15:31:37.777346 28324 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 9641 or (T in {9641})}] I0302 15:31:37.778465 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:37.778887 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:37.787513 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:37.787770 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:37.792240 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72beb55018036ea64e31b7e9cea008d1c1fc I0302 15:31:37.792747 28368 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:37.794082 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6c2b35aab690e4733827d8c665ce8da1e I0302 15:31:37.794199 28413 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:37.794329 28413 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:37.794373 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 9652 or (T in {9652})}] I0302 15:31:37.796135 28368 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:37.796329 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 9646 or (T in {9646,9649,9652})}] I0302 15:31:37.814514 28413 tablet.cc:1059] Compaction successful on 46040 rows (1162954 bytes) I0302 15:31:37.827389 28413 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.182s user 0.049s sys 0.016s I0302 15:31:37.827839 28368 tablet.cc:1059] Compaction successful on 47372 rows (1194922 bytes) I0302 15:31:37.831495 28368 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.242s user 0.052s sys 0.016s I0302 15:31:37.839659 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 4 rowsets to compact I0302 15:31:37.839704 28368 compaction.cc:552] Selected 4 rowsets to compact: I0302 15:31:37.839745 28368 compaction.cc:555] RowSet(0)(current size on disk: ~270149 bytes) I0302 15:31:37.839778 28368 compaction.cc:555] RowSet(1)(current size on disk: ~266645 bytes) I0302 15:31:37.839803 28368 compaction.cc:555] RowSet(2)(current size on disk: ~268349 bytes) I0302 15:31:37.839831 28368 compaction.cc:555] RowSet(3)(current size on disk: ~258125 bytes) I0302 15:31:37.839893 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 9684 or (T in {9684})}] I0302 15:31:37.841593 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:37.841835 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:37.842093 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:37.842357 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:37.895037 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 4 rowsets to compact I0302 15:31:37.895064 28413 compaction.cc:552] Selected 4 rowsets to compact: I0302 15:31:37.895081 28413 compaction.cc:555] RowSet(0)(current size on disk: ~314693 bytes) I0302 15:31:37.895097 28413 compaction.cc:555] RowSet(1)(current size on disk: ~267437 bytes) I0302 15:31:37.895109 28413 compaction.cc:555] RowSet(2)(current size on disk: ~274325 bytes) I0302 15:31:37.895124 28413 compaction.cc:555] RowSet(3)(current size on disk: ~399969 bytes) I0302 15:31:37.895143 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 9728 or (T in {9728})}] I0302 15:31:37.895715 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:37.897269 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:37.898846 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:37.899114 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:37.947686 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deaa800202993bd4bee9a9c96ee1ba1efe7 I0302 15:31:37.948232 28324 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:37.949926 28324 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:37.949973 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 9772 or (T in {9772,9775})}] I0302 15:31:37.971699 28324 tablet.cc:1059] Compaction successful on 47064 rows (1187530 bytes) I0302 15:31:37.978749 28324 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.202s user 0.052s sys 0.013s I0302 15:31:38.023027 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72beb6091af9934c4810b65f413a1d86dcfe I0302 15:31:38.023110 28368 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:38.026656 28368 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:38.026708 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 9819 or (T in {9819,9821})}] I0302 15:31:38.027267 28324 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:38.027310 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000001 (GCed ops < 2789) I0302 15:31:38.028193 28324 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.001s I0302 15:31:38.049578 28368 tablet.cc:1059] Compaction successful on 44238 rows (1115586 bytes) I0302 15:31:38.052451 28368 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.213s user 0.051s sys 0.011s I0302 15:31:38.077172 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b67d2611d1c9a244859923ff9a0a956417 I0302 15:31:38.077232 28413 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:38.077868 28413 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:38.077913 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 9865 or (T in {9865,9868})}] I0302 15:31:38.089725 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:38.089910 28368 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:38.089946 28368 compaction.cc:555] RowSet(0)(current size on disk: ~342317 bytes) I0302 15:31:38.089972 28368 compaction.cc:555] RowSet(1)(current size on disk: ~263261 bytes) I0302 15:31:38.089997 28368 compaction.cc:555] RowSet(2)(current size on disk: ~266693 bytes) I0302 15:31:38.090024 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 9879 or (T in {9879})}] I0302 15:31:38.090425 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:38.090643 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:38.091002 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:38.092218 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:38.101024 28413 tablet.cc:1059] Compaction successful on 52286 rows (1321098 bytes) I0302 15:31:38.104440 28413 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.209s user 0.056s sys 0.013s I0302 15:31:38.145126 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:38.145150 28413 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:38.145165 28413 compaction.cc:555] RowSet(0)(current size on disk: ~350525 bytes) I0302 15:31:38.145180 28413 compaction.cc:555] RowSet(1)(current size on disk: ~261461 bytes) I0302 15:31:38.145192 28413 compaction.cc:555] RowSet(2)(current size on disk: ~266909 bytes) I0302 15:31:38.145210 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 9936 or (T in {9936})}] I0302 15:31:38.145608 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:38.145822 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:38.146036 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:38.146323 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:38.235129 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be7251cea3974e46748615cd2d6f5b32a2 I0302 15:31:38.235201 28368 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:38.235666 28368 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:38.235702 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 10010 or (T in {10010,10013})}] I0302 15:31:38.255682 28368 tablet.cc:1059] Compaction successful on 36296 rows (916738 bytes) I0302 15:31:38.260164 28368 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.170s user 0.039s sys 0.012s I0302 15:31:38.267017 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6e58511df9ab944409cd4e46c9bdc1d94 I0302 15:31:38.267066 28413 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:38.269876 28413 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:38.269906 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 10044 or (T in {10044,10048})}] I0302 15:31:38.277436 28324 tablet.cc:1081] Compaction: stage 1 complete, picked 4 rowsets to compact I0302 15:31:38.277462 28324 compaction.cc:552] Selected 4 rowsets to compact: I0302 15:31:38.277477 28324 compaction.cc:555] RowSet(0)(current size on disk: ~262709 bytes) I0302 15:31:38.277492 28324 compaction.cc:555] RowSet(1)(current size on disk: ~266021 bytes) I0302 15:31:38.277504 28324 compaction.cc:555] RowSet(2)(current size on disk: ~266885 bytes) I0302 15:31:38.277518 28324 compaction.cc:555] RowSet(3)(current size on disk: ~260189 bytes) I0302 15:31:38.277536 28324 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 10059 or (T in {10059})}] I0302 15:31:38.278281 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:38.278592 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:38.278893 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:38.279171 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:38.285338 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:43948/tablets I0302 15:31:38.289872 28413 tablet.cc:1059] Compaction successful on 36572 rows (923362 bytes) I0302 15:31:38.293570 28413 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.148s user 0.042s sys 0.007s I0302 15:31:38.341332 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:38.341363 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:38.341383 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:38.341409 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:38.341434 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 10113 or (T in {10113})}] I0302 15:31:38.341871 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:38.342139 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:38.342479 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:38.342775 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] W0302 15:31:38.491716 28497 log.cc:433] Time spent Append to log took a long time: real 0.106s user 0.000s sys 0.000s W0302 15:31:38.491718 28475 log.cc:433] Time spent Append to log took a long time: real 0.106s user 0.000s sys 0.000s W0302 15:31:38.491777 28495 log.cc:433] Time spent Append to log took a long time: real 0.106s user 0.000s sys 0.000s W0302 15:31:38.492080 28489 log.cc:433] Time spent Append to log took a long time: real 0.107s user 0.000s sys 0.000s W0302 15:31:38.492087 28484 log.cc:433] Time spent Append to log took a long time: real 0.107s user 0.000s sys 0.000s W0302 15:31:38.492269 28496 log.cc:433] Time spent Append to log took a long time: real 0.107s user 0.000s sys 0.000s I0302 15:31:38.493166 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:38.493208 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:38.493247 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:38.493289 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:38.493335 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 10155 or (T in {10155})}] I0302 15:31:38.493679 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:38.493896 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:38.494209 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:38.494485 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:38.640422 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dead9c434666b94441aa8263383f8c7636c I0302 15:31:38.640476 28324 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:38.642743 28324 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:38.642763 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 10256 or (T in {10256,10259})}] I0302 15:31:38.642915 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bee2caffe5f161421b9c5bcbf1b9d3756f I0302 15:31:38.642985 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:38.647635 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:38.647676 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 10253 or (T in {10253,10256})}] I0302 15:31:38.648670 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6d1355f0213d14820920aed0c4c5726f1 I0302 15:31:38.648846 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:38.648938 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:38.648980 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 10260 or (T in {10260})}] I0302 15:31:38.653025 28368 tablet.cc:1059] Flush successful on 12407 rows (314474 bytes) I0302 15:31:38.653215 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.313s user 0.013s sys 0.007s I0302 15:31:38.655433 28413 tablet.cc:1059] Flush successful on 10850 rows (277106 bytes) I0302 15:31:38.655681 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.260s user 0.009s sys 0.006s I0302 15:31:38.662143 28324 tablet.cc:1059] Compaction successful on 43927 rows (1108122 bytes) I0302 15:31:38.666622 28324 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.389s user 0.051s sys 0.011s I0302 15:31:38.780267 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:38.780292 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:38.780309 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:38.780323 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:38.780349 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 10394 or (T in {10394})}] I0302 15:31:38.780762 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:38.781003 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:38.781255 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:38.781440 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:38.838045 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deab4519fca38504213a27173d859b97e75 I0302 15:31:38.838104 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:38.840502 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:38.840548 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 10441 or (T in {10441,10444})}] I0302 15:31:38.841223 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:38.841246 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:38.841264 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:38.841279 28368 tablet.cc:575] Memstore in-memory size: 4079383 bytes I0302 15:31:38.841302 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 10440 or (T in {10440})}] I0302 15:31:38.841698 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:38.841936 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:38.842144 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:38.842329 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:38.849521 28324 tablet.cc:1059] Flush successful on 14271 rows (363330 bytes) I0302 15:31:38.849689 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.072s user 0.015s sys 0.005s I0302 15:31:38.895926 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:38.895952 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:38.895967 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:38.895978 28413 tablet.cc:575] Memstore in-memory size: 4079383 bytes I0302 15:31:38.895995 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 10489 or (T in {10489})}] I0302 15:31:38.896342 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:38.896587 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:38.897276 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:38.897492 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:38.920042 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be95b189c1537843aea10a9e59e61af5bb I0302 15:31:38.920125 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:38.920198 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:38.920233 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 10507 or (T in {10507})}] I0302 15:31:38.936476 28368 tablet.cc:1059] Flush successful on 21986 rows (556730 bytes) I0302 15:31:38.936961 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.097s user 0.020s sys 0.006s I0302 15:31:38.992310 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b64288a5ca95f8436ba1cae8cbf6b9b695 I0302 15:31:38.992413 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:38.997154 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:38.997205 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 10559 or (T in {10559,10563})}] I0302 15:31:39.004217 28413 tablet.cc:1059] Flush successful on 21951 rows (555890 bytes) I0302 15:31:39.004410 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.109s user 0.019s sys 0.007s I0302 15:31:39.027848 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:39.027883 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:39.027896 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:39.027920 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:39.027940 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 10597 or (T in {10597})}] I0302 15:31:39.028373 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:39.028936 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:39.029217 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:39.029469 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:39.088052 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea63e4101ee11a439fa44720a8a0c26526 I0302 15:31:39.088116 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:39.088732 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:39.088791 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 10645 or (T in {10645,10648})}] I0302 15:31:39.092352 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:39.092378 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:39.092398 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:39.092412 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:39.092433 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 10645 or (T in {10645})}] I0302 15:31:39.092977 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:39.093231 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:39.093502 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:39.093785 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:39.102625 28324 tablet.cc:1059] Flush successful on 12427 rows (314954 bytes) I0302 15:31:39.102905 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.075s user 0.019s sys 0.002s I0302 15:31:39.147897 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be9007239c50f540c5b5b05f95624d972a I0302 15:31:39.147980 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:39.150732 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:39.150784 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 10693 or (T in {10693,10696})}] I0302 15:31:39.155519 28368 tablet.cc:1059] Flush successful on 12431 rows (315050 bytes) I0302 15:31:39.155663 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.065s user 0.015s sys 0.004s I0302 15:31:39.285496 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/jsonmetricz I0302 15:31:39.530694 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:39.530732 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:39.530748 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:39.530767 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:39.530791 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 11124 or (T in {11124})}] I0302 15:31:39.531224 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:39.531414 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:39.531613 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:39.531792 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:39.617527 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea099b428fab16456ebfd23fdba079569e I0302 15:31:39.617600 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:39.619690 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:39.619732 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 11211 or (T in {11211,11213})}] I0302 15:31:39.626392 28324 tablet.cc:1059] Flush successful on 10924 rows (278882 bytes) I0302 15:31:39.626644 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.099s user 0.009s sys 0.008s I0302 15:31:39.647332 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:39.647357 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:39.647373 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:39.647388 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:39.647403 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 11232 or (T in {11232})}] I0302 15:31:39.647712 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:39.647924 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:39.648103 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:39.648280 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:39.688483 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6a03dc5c702644cd1bace30c291e4a4d2 I0302 15:31:39.688572 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:39.691047 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:39.691083 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 11271 or (T in {11271,11274})}] I0302 15:31:39.695147 28413 tablet.cc:1059] Flush successful on 10797 rows (275834 bytes) I0302 15:31:39.695251 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.049s user 0.013s sys 0.002s I0302 15:31:40.285662 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/masterz I0302 15:31:40.593125 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:40.593161 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:40.593191 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:40.593221 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:40.593245 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 12301 or (T in {12301})}] I0302 15:31:40.593600 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:40.593808 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:40.594082 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:40.594346 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:40.646350 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:40.646378 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:40.646392 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:40.646409 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:40.646428 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 12358 or (T in {12358})}] I0302 15:31:40.646759 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:40.647032 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:40.647346 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:40.647702 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:40.663664 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bed2082eb540a74927a87ca30fb92fe54f I0302 15:31:40.663761 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:40.665930 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:40.665977 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 12370 or (T in {12370,12376,12373})}] I0302 15:31:40.671593 28368 tablet.cc:1059] Flush successful on 12145 rows (308186 bytes) I0302 15:31:40.671803 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.081s user 0.010s sys 0.007s I0302 15:31:40.726425 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6317bb489ac0e45ce9668084fd16ed040 I0302 15:31:40.726516 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:40.726625 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:40.726671 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 12438 or (T in {12438})}] I0302 15:31:40.731397 28413 tablet.cc:1059] Flush successful on 12229 rows (310202 bytes) I0302 15:31:40.731782 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.086s user 0.011s sys 0.009s I0302 15:31:40.780474 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:40.780505 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:40.780520 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:40.780532 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:40.780565 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 12503 or (T in {12503})}] I0302 15:31:40.780941 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:40.781209 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:40.781450 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:40.781734 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:40.831240 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deadc4efc6523fd407db8dd76cf7af0f4e6 I0302 15:31:40.831290 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:40.833829 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:40.833892 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 12553 or (T in {12553,12556})}] I0302 15:31:40.839690 28324 tablet.cc:1059] Flush successful on 11669 rows (296762 bytes) I0302 15:31:40.839861 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.061s user 0.011s sys 0.007s I0302 15:31:40.841174 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:40.841202 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:40.841229 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:40.841248 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:40.841274 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 12557 or (T in {12557})}] I0302 15:31:40.841651 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:40.841935 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:40.842243 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:40.842578 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:40.897450 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:40.897480 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:40.897495 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:40.897503 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:40.897516 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 12604 or (T in {12604})}] I0302 15:31:40.897799 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:40.898375 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:40.898566 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:40.898818 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:40.938009 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be7be7da39501842f192d393e894d581df I0302 15:31:40.938109 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:40.938328 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:40.938385 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 12641 or (T in {12641,12644})}] I0302 15:31:40.947096 28368 tablet.cc:1059] Flush successful on 11856 rows (301250 bytes) I0302 15:31:40.947430 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.106s user 0.013s sys 0.007s I0302 15:31:40.958971 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b636a7d6da29db41fb82b7bfe483754904 I0302 15:31:40.959094 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:40.962843 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:40.963474 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 12663 or (T in {12663,12667,12670})}] I0302 15:31:40.966739 28476 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:40.967880 28497 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:40.967967 28495 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:40.968475 28497 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000004 I0302 15:31:40.968891 28476 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000004 I0302 15:31:40.968955 28413 tablet.cc:1059] Flush successful on 11862 rows (301394 bytes) I0302 15:31:40.969092 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.073s user 0.011s sys 0.006s I0302 15:31:40.971246 28495 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000004 I0302 15:31:41.002392 28473 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:41.002845 28496 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:41.003105 28475 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:41.003829 28475 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000004 I0302 15:31:41.003871 28473 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000004 I0302 15:31:41.003923 28496 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000004 I0302 15:31:41.008361 28484 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:41.008766 28489 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:41.009102 28478 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:41.010777 28478 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000004 I0302 15:31:41.011030 28484 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000004 I0302 15:31:41.011472 28489 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000004 I0302 15:31:41.028815 28324 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:41.028842 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 (GCed ops < 3705) I0302 15:31:41.029433 28324 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.000s I0302 15:31:41.091277 28368 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:41.091302 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 (GCed ops < 4186) I0302 15:31:41.091761 28368 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.000s user 0.000s sys 0.000s I0302 15:31:41.146565 28413 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:41.146594 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 (GCed ops < 4201) I0302 15:31:41.147274 28413 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.000s I0302 15:31:41.278904 28324 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:41.278928 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 (GCed ops < 3529) I0302 15:31:41.279618 28324 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.001s I0302 15:31:41.285837 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/tablez I0302 15:31:41.341384 28368 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:41.341411 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 (GCed ops < 3546) I0302 15:31:41.341953 28368 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.001s I0302 15:31:41.396708 28413 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:41.396888 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 (GCed ops < 3742) I0302 15:31:41.397451 28413 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.000s I0302 15:31:41.529021 28324 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:41.529047 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 (GCed ops < 4168) I0302 15:31:41.529675 28324 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.001s sys 0.000s I0302 15:31:41.591516 28368 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:41.591547 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 (GCed ops < 4104) I0302 15:31:41.592136 28368 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.001s I0302 15:31:41.647347 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:41.647378 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:41.647393 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:41.647406 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:41.647456 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 13466 or (T in {13466})}] I0302 15:31:41.647925 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:41.648138 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:41.648355 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:41.648618 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:41.726871 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6f69e5f6c990340d09b98378a29cbec94 I0302 15:31:41.726984 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:41.728052 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:41.728127 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 13527 or (T in {13527,13531})}] I0302 15:31:41.732462 28413 tablet.cc:1059] Flush successful on 12442 rows (315314 bytes) I0302 15:31:41.732734 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.086s user 0.012s sys 0.007s I0302 15:31:41.779515 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:41.779536 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:41.779549 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:41.779557 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:41.779578 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 13594 or (T in {13594})}] I0302 15:31:41.779871 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:41.780055 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:41.780252 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:41.780462 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:41.843760 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:41.843790 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:41.843804 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:41.843832 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:41.843873 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 13652 or (T in {13652})}] I0302 15:31:41.844293 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:41.844537 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:41.844739 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:41.844936 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:41.861562 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea5a1c1d6ceb5c47bba525d5c6d85ac281 I0302 15:31:41.861649 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:41.861794 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:41.861829 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 13676 or (T in {13676})}] I0302 15:31:41.868319 28324 tablet.cc:1059] Flush successful on 16764 rows (423162 bytes) I0302 15:31:41.868466 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.089s user 0.015s sys 0.006s I0302 15:31:41.910406 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be3c89b5ab7ce24c479acbd0275000500e I0302 15:31:41.910488 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:41.912621 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:41.912662 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 13716 or (T in {13716,13719})}] I0302 15:31:41.917707 28368 tablet.cc:1059] Flush successful on 16789 rows (423762 bytes) I0302 15:31:41.918133 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.077s user 0.016s sys 0.004s I0302 15:31:42.032645 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:42.032678 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:42.032698 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:42.032714 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:42.032745 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 13870 or (T in {13870})}] I0302 15:31:42.033133 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:42.033388 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:42.033677 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:42.033946 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:42.089826 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea1234b905e3724091ad7b454fe55110e7 I0302 15:31:42.089872 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:42.091897 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:42.092159 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 13927 or (T in {13927,13929})}] I0302 15:31:42.096778 28324 tablet.cc:1059] Flush successful on 15568 rows (394458 bytes) I0302 15:31:42.096935 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.068s user 0.011s sys 0.008s I0302 15:31:42.146973 28413 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:42.146996 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 (GCed ops < 4123) I0302 15:31:42.147610 28413 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.001s I0302 15:31:42.286003 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/tablet-servers I0302 15:31:42.529711 28324 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:42.529737 28324 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:42.529747 28324 compaction.cc:555] RowSet(4)(current size on disk: ~1226761 bytes) I0302 15:31:42.529757 28324 compaction.cc:555] RowSet(5)(current size on disk: ~262565 bytes) I0302 15:31:42.529764 28324 compaction.cc:555] RowSet(6)(current size on disk: ~374021 bytes) I0302 15:31:42.529777 28324 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 14414 or (T in {14414})}] I0302 15:31:42.530175 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:42.530405 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:42.530657 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:42.530979 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:42.591966 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:42.591995 28368 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:42.592011 28368 compaction.cc:555] RowSet(3)(current size on disk: ~871585 bytes) I0302 15:31:42.592025 28368 compaction.cc:555] RowSet(4)(current size on disk: ~528057 bytes) I0302 15:31:42.592039 28368 compaction.cc:555] RowSet(5)(current size on disk: ~284933 bytes) I0302 15:31:42.592068 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 14469 or (T in {14469})}] I0302 15:31:42.592782 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:42.593092 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:42.593456 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:42.593713 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:42.647629 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:42.647686 28413 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:42.647708 28413 compaction.cc:555] RowSet(3)(current size on disk: ~878209 bytes) I0302 15:31:42.647744 28413 compaction.cc:555] RowSet(4)(current size on disk: ~527217 bytes) I0302 15:31:42.647773 28413 compaction.cc:555] RowSet(5)(current size on disk: ~285077 bytes) I0302 15:31:42.647812 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 14512 or (T in {14512})}] I0302 15:31:42.648764 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:42.649137 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:42.649370 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:42.649641 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:42.744004 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea4fb21d3d02364c798b268402de7cfcda I0302 15:31:42.744063 28324 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:42.746768 28324 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:42.746804 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 14593 or (T in {14593,14597})}] I0302 15:31:42.791965 28324 tablet.cc:1059] Compaction successful on 77587 rows (1957250 bytes) I0302 15:31:42.795078 28324 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.265s user 0.073s sys 0.019s I0302 15:31:42.890789 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be80ffeea2071b44c9b841e96616018bd7 I0302 15:31:42.890883 28368 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:42.890990 28368 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:42.891036 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 14695 or (T in {14695})}] I0302 15:31:42.895575 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b641ef6c81a2644d8a93345032647887c0 I0302 15:31:42.895723 28413 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:42.899082 28413 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:42.899147 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 14696 or (T in {14696,14701})}] I0302 15:31:42.913776 28368 tablet.cc:1059] Compaction successful on 70138 rows (1770234 bytes) I0302 15:31:42.918790 28368 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.327s user 0.086s sys 0.018s I0302 15:31:42.923940 28413 tablet.cc:1059] Compaction successful on 70385 rows (1776162 bytes) I0302 15:31:42.927342 28413 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.280s user 0.070s sys 0.021s I0302 15:31:43.030321 28324 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:43.030362 28324 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:43.030381 28324 compaction.cc:555] RowSet(4)(current size on disk: ~1130017 bytes) I0302 15:31:43.030408 28324 compaction.cc:555] RowSet(5)(current size on disk: ~298637 bytes) I0302 15:31:43.030427 28324 compaction.cc:555] RowSet(6)(current size on disk: ~402729 bytes) I0302 15:31:43.030462 28324 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 14840 or (T in {14840})}] I0302 15:31:43.031267 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:43.031486 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:43.031697 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:43.031903 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:43.092119 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:43.092146 28368 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:43.092156 28368 compaction.cc:555] RowSet(4)(current size on disk: ~1137409 bytes) I0302 15:31:43.092165 28368 compaction.cc:555] RowSet(5)(current size on disk: ~298733 bytes) I0302 15:31:43.092174 28368 compaction.cc:555] RowSet(6)(current size on disk: ~403329 bytes) I0302 15:31:43.092185 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 14899 or (T in {14899})}] I0302 15:31:43.092576 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:43.092782 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:43.093091 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:43.093401 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:43.147689 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:43.147721 28413 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:43.147737 28413 compaction.cc:555] RowSet(4)(current size on disk: ~1105441 bytes) I0302 15:31:43.147753 28413 compaction.cc:555] RowSet(5)(current size on disk: ~260789 bytes) I0302 15:31:43.147771 28413 compaction.cc:555] RowSet(6)(current size on disk: ~293885 bytes) I0302 15:31:43.147794 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 14942 or (T in {14942})}] I0302 15:31:43.149233 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:43.149507 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:43.149772 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:43.150059 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:43.199514 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deaa46026cf659c402e9c508fb888cd4f91 I0302 15:31:43.199621 28324 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:43.199738 28324 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:43.199784 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 14992 or (T in {14992})}] I0302 15:31:43.231667 28324 tablet.cc:1059] Compaction successful on 76255 rows (1925282 bytes) I0302 15:31:43.241231 28324 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.211s user 0.074s sys 0.021s I0302 15:31:43.280130 28324 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:43.280177 28324 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:43.280203 28324 compaction.cc:555] RowSet(4)(current size on disk: ~1054729 bytes) I0302 15:31:43.280228 28324 compaction.cc:555] RowSet(5)(current size on disk: ~342893 bytes) I0302 15:31:43.280252 28324 compaction.cc:555] RowSet(6)(current size on disk: ~280445 bytes) I0302 15:31:43.280280 28324 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 15044 or (T in {15044})}] I0302 15:31:43.280695 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:43.280910 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:43.281255 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:43.281455 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:43.286558 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:40132/jsonmetricz I0302 15:31:43.315176 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72beefef012e07744665bfa49b26863d2f24 I0302 15:31:43.315282 28368 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:43.317859 28368 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:43.317909 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 15069 or (T in {15069,15072})}] I0302 15:31:43.351487 28368 tablet.cc:1059] Compaction successful on 76592 rows (1933370 bytes) I0302 15:31:43.352025 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b69c297b34d2854d4ab30ade482d8adaf1 I0302 15:31:43.352094 28413 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:43.352166 28413 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:43.352198 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 15106 or (T in {15106})}] I0302 15:31:43.357851 28368 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.266s user 0.072s sys 0.024s I0302 15:31:43.382316 28413 tablet.cc:1059] Compaction successful on 69119 rows (1745778 bytes) I0302 15:31:43.389070 28413 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.241s user 0.079s sys 0.018s I0302 15:31:43.397814 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:43.398654 28413 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:43.398694 28413 compaction.cc:555] RowSet(4)(current size on disk: ~1255345 bytes) I0302 15:31:43.398726 28413 compaction.cc:555] RowSet(5)(current size on disk: ~259517 bytes) I0302 15:31:43.398768 28413 compaction.cc:555] RowSet(6)(current size on disk: ~298997 bytes) I0302 15:31:43.398813 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 15150 or (T in {15150})}] I0302 15:31:43.399327 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:43.400665 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:43.401041 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:43.401618 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:43.467811 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea2fd5ecbc74be4a5798dcf6b02327e89c I0302 15:31:43.467910 28324 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:43.470777 28324 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:43.470844 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 15217 or (T in {15217,15219})}] I0302 15:31:43.489598 28324 tablet.cc:1059] Compaction successful on 69867 rows (1763730 bytes) I0302 15:31:43.494781 28324 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.215s user 0.071s sys 0.018s I0302 15:31:43.531618 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:43.531666 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:43.531694 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:43.531811 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:43.531849 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 15277 or (T in {15277})}] I0302 15:31:43.534958 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:43.538358 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:43.538893 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:43.539460 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:43.582554 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b60b188e5d09cd47c5b79bb1151a7de8e9 I0302 15:31:43.582674 28413 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:43.584367 28413 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:43.584415 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 15311 or (T in {15311,15315})}] I0302 15:31:43.592360 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:43.592386 28368 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:43.592399 28368 compaction.cc:555] RowSet(4)(current size on disk: ~1062193 bytes) I0302 15:31:43.592416 28368 compaction.cc:555] RowSet(5)(current size on disk: ~298157 bytes) I0302 15:31:43.592427 28368 compaction.cc:555] RowSet(6)(current size on disk: ~291869 bytes) I0302 15:31:43.592445 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 15320 or (T in {15320})}] I0302 15:31:43.593011 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:43.593220 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:43.593431 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:43.593715 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:43.613185 28413 tablet.cc:1059] Compaction successful on 75525 rows (1907762 bytes) I0302 15:31:43.623394 28413 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.226s user 0.072s sys 0.018s I0302 15:31:43.638993 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deac00aa28fa003452fb51f80b7b789c1e8 I0302 15:31:43.639060 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:43.640228 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:43.640272 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 15366 or (T in {15366,15370})}] I0302 15:31:43.646809 28324 tablet.cc:1059] Flush successful on 15389 rows (390162 bytes) I0302 15:31:43.646958 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.117s user 0.017s sys 0.005s I0302 15:31:43.648598 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:43.648624 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:43.648639 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:43.648658 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:43.648684 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 15372 or (T in {15372})}] I0302 15:31:43.649060 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:43.649360 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:43.649670 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:43.649885 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:43.785954 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b69ae8ba8455ca4e399f51d45c6ccc021f I0302 15:31:43.786061 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:43.786173 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:43.786237 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 15481 or (T in {15481})}] I0302 15:31:43.793877 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be2e58fccb40764ab48ffddbca50867e24 I0302 15:31:43.793977 28368 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:43.798750 28368 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:43.798756 28413 tablet.cc:1059] Flush successful on 16741 rows (422610 bytes) I0302 15:31:43.798802 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 15484 or (T in {15484,15490,15487})}] I0302 15:31:43.799037 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.151s user 0.013s sys 0.009s I0302 15:31:43.822113 28368 tablet.cc:1059] Compaction successful on 68790 rows (1737882 bytes) I0302 15:31:43.825676 28368 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.233s user 0.064s sys 0.017s I0302 15:31:43.845629 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:43.845685 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:43.845732 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:43.845768 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:43.845809 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 15541 or (T in {15541})}] I0302 15:31:43.846139 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:43.846339 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:43.846869 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:43.847849 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:43.899883 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:43.899907 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:43.899922 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:43.899935 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:43.899955 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 15593 or (T in {15593})}] I0302 15:31:43.900370 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:43.900995 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:43.901273 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:43.901517 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:43.915107 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be4dccbe23bba940018a67126de9632bfc I0302 15:31:43.915220 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:43.917196 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:43.917230 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 15607 or (T in {15607,15610})}] I0302 15:31:43.929069 28368 tablet.cc:1059] Flush successful on 18035 rows (457786 bytes) I0302 15:31:43.929312 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.086s user 0.017s sys 0.006s I0302 15:31:43.970932 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6b59ba05533fd458da35ec507a5308a13 I0302 15:31:43.971053 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:43.973951 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:43.974016 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 15663 or (T in {15663,15666,15669})}] I0302 15:31:43.984632 28413 tablet.cc:1059] Flush successful on 11929 rows (303002 bytes) I0302 15:31:43.984907 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.087s user 0.014s sys 0.004s I0302 15:31:44.031097 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:44.031128 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:44.031141 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:44.031152 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:44.031167 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 15736 or (T in {15736})}] I0302 15:31:44.031474 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:44.031685 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:44.031862 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:44.032053 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:44.075111 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea24150487045246599be1c57f23308e12 I0302 15:31:44.075253 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:44.075911 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:44.075948 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 15773 or (T in {15773,15776})}] I0302 15:31:44.085291 28324 tablet.cc:1059] Flush successful on 11950 rows (303506 bytes) I0302 15:31:44.085527 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.055s user 0.006s sys 0.009s I0302 15:31:44.094066 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:44.094096 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:44.094122 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:44.094143 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:44.094187 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 15788 or (T in {15788})}] I0302 15:31:44.094548 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:44.094835 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:44.095088 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:44.095264 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:44.149834 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:44.149869 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:44.149886 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:44.149909 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:44.149950 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 15838 or (T in {15838})}] I0302 15:31:44.150344 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:44.150696 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:44.151010 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:44.151243 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:44.163533 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bebaf710fd6a6149cca6aafbc39e1dd726 I0302 15:31:44.163645 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:44.166126 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:44.166184 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 15849 or (T in {15849,15853})}] I0302 15:31:44.171123 28368 tablet.cc:1059] Flush successful on 11934 rows (303122 bytes) I0302 15:31:44.171792 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.079s user 0.012s sys 0.005s I0302 15:31:44.215728 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b693aca4ee4e8f4c38bb5ee861fef1f527 I0302 15:31:44.215879 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:44.218358 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:44.218417 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 15907 or (T in {15907,15910})}] I0302 15:31:44.229785 28413 tablet.cc:1059] Flush successful on 18154 rows (460642 bytes) I0302 15:31:44.230170 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.082s user 0.016s sys 0.009s I0302 15:31:44.282413 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:44.282443 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:44.282454 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:44.282464 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:44.282484 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 15988 or (T in {15988})}] I0302 15:31:44.282845 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:44.283030 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:44.283321 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:44.283562 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:44.286715 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:40132/tablets I0302 15:31:44.330024 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea846c4d34156247eaae35c0603b0af346 I0302 15:31:44.330128 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:44.331830 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:44.331889 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 16029 or (T in {16029,16032})}] I0302 15:31:44.337167 28324 tablet.cc:1059] Flush successful on 11714 rows (297842 bytes) I0302 15:31:44.337677 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.057s user 0.012s sys 0.006s I0302 15:31:44.342975 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:44.343006 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:44.343032 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:44.343055 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:44.343088 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 16036 or (T in {16036})}] I0302 15:31:44.343457 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:44.343649 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:44.343847 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:44.344022 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:44.449820 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bef01938018cac4e12a3aa459221f766c1 I0302 15:31:44.449908 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:44.449980 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:44.450013 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 16119 or (T in {16119})}] I0302 15:31:44.455013 28368 tablet.cc:1059] Flush successful on 19523 rows (493498 bytes) I0302 15:31:44.455137 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.112s user 0.016s sys 0.007s I0302 15:31:45.147485 28497 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:45.147862 28476 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:45.149103 28476 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000005 I0302 15:31:45.149792 28497 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000005 I0302 15:31:45.150239 28495 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:45.152322 28495 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000005 I0302 15:31:45.174255 28489 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:45.174525 28478 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:45.174826 28484 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:45.176089 28478 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000005 I0302 15:31:45.176586 28489 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000005 I0302 15:31:45.177310 28484 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000005 I0302 15:31:45.190485 28473 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:45.190917 28475 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:45.191100 28496 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:45.191699 28475 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000005 I0302 15:31:45.192062 28473 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000005 I0302 15:31:45.193866 28496 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000005 I0302 15:31:45.281188 28324 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:45.281218 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000003 (GCed ops < 5091) I0302 15:31:45.281853 28324 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.001s I0302 15:31:45.286870 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:55689/jsonmetricz I0302 15:31:45.343458 28368 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:45.343478 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000003 (GCed ops < 5262) I0302 15:31:45.343946 28368 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.000s user 0.000s sys 0.000s I0302 15:31:45.398777 28413 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:45.398800 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000003 (GCed ops < 5197) I0302 15:31:45.399534 28413 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.000s I0302 15:31:45.531247 28324 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:45.531278 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000003 (GCed ops < 5243) I0302 15:31:45.531898 28324 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.001s I0302 15:31:45.593634 28368 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:45.593665 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000003 (GCed ops < 5182) I0302 15:31:45.594295 28368 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.000s I0302 15:31:45.649049 28413 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:45.649075 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000003 (GCed ops < 5126) I0302 15:31:45.649610 28413 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.001s I0302 15:31:45.781291 28324 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:45.781316 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000003 (GCed ops < 5324) I0302 15:31:45.781847 28324 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.001s I0302 15:31:45.843755 28368 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:45.843786 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000003 (GCed ops < 5344) I0302 15:31:45.844389 28368 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.000s I0302 15:31:45.899003 28413 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:45.899044 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000003 (GCed ops < 5277) I0302 15:31:45.899721 28413 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.001s I0302 15:31:46.032289 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:46.032325 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:46.032341 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:46.032356 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:46.032377 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 17995 or (T in {17995})}] I0302 15:31:46.032810 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:46.033077 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:46.033298 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:46.033484 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:46.095291 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:46.095316 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:46.095329 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:46.095336 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:46.095353 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 18055 or (T in {18055})}] I0302 15:31:46.095854 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:46.096169 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:46.096761 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:46.096997 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:46.108846 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea365213bd66dd4233802854437ac7ac1a I0302 15:31:46.108919 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:46.111129 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:46.111194 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 18072 or (T in {18072,18075})}] I0302 15:31:46.119107 28324 tablet.cc:1059] Flush successful on 15124 rows (383802 bytes) I0302 15:31:46.119345 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.088s user 0.013s sys 0.006s I0302 15:31:46.149245 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:46.149271 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:46.149281 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:46.149288 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:46.149301 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 18111 or (T in {18111})}] I0302 15:31:46.149622 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:46.149976 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:46.150286 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:46.150637 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:46.166043 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be699365a345b64d22849a7956ffd72751 I0302 15:31:46.166129 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:46.168601 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:46.168726 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 18127 or (T in {18127,18130})}] I0302 15:31:46.173737 28368 tablet.cc:1059] Flush successful on 13921 rows (354930 bytes) I0302 15:31:46.173969 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.080s user 0.014s sys 0.006s I0302 15:31:46.236739 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b61224ffe221214ab0acf2aac4e9bb8643 I0302 15:31:46.236845 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:46.236923 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:46.236958 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 18201 or (T in {18201})}] I0302 15:31:46.243681 28413 tablet.cc:1059] Flush successful on 15207 rows (385794 bytes) I0302 15:31:46.243865 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.095s user 0.014s sys 0.005s I0302 15:31:46.281734 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:46.281759 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:46.281781 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:46.281795 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:46.281813 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 18263 or (T in {18263})}] I0302 15:31:46.282146 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:46.282335 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:46.282598 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:46.282894 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:46.287024 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:55689/tablets I0302 15:31:46.342885 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea5f2e2623e38c46d6b6ffd4655756eee5 I0302 15:31:46.343071 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:46.343592 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:46.343641 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 18327 or (T in {18327,18330})}] I0302 15:31:46.346182 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:46.346207 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:46.346225 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:46.346236 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:46.346248 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 18323 or (T in {18323})}] I0302 15:31:46.346523 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:46.346810 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:46.347076 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:46.347328 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:46.355567 28324 tablet.cc:1059] Flush successful on 14200 rows (361626 bytes) I0302 15:31:46.355850 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.074s user 0.016s sys 0.005s I0302 15:31:46.401489 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:46.401517 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:46.401528 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:46.401538 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:46.401554 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 18377 or (T in {18377})}] I0302 15:31:46.401844 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:46.402075 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:46.402261 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:46.402320 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bec370e1a6fa23444486823900b7488ca5 I0302 15:31:46.402371 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:46.402452 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:46.405910 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:46.405947 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 18377 or (T in {18377,18380})}] I0302 15:31:46.413266 28368 tablet.cc:1059] Flush successful on 14250 rows (362826 bytes) I0302 15:31:46.413431 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.069s user 0.017s sys 0.003s I0302 15:31:46.459494 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b63c2bb59d125049ebb9a7ef585dadf5b9 I0302 15:31:46.459552 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:46.461500 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:46.461534 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 18425 or (T in {18425,18428})}] I0302 15:31:46.465312 28413 tablet.cc:1059] Flush successful on 15621 rows (395730 bytes) I0302 15:31:46.465427 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.066s user 0.011s sys 0.008s I0302 15:31:46.533699 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:46.533725 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:46.533736 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:46.533747 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:46.533782 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 18512 or (T in {18512})}] I0302 15:31:46.534103 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:46.534399 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:46.534617 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:46.534808 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:46.594166 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:46.594190 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:46.594200 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:46.594208 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:46.594221 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 18561 or (T in {18561})}] I0302 15:31:46.594527 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:46.594799 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:46.595728 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:46.596010 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:46.633272 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea0c16a9ef7611444d98c15bbba8129bfe I0302 15:31:46.633352 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:46.635267 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:46.635304 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 18593 or (T in {18593,18597})}] I0302 15:31:46.648684 28324 tablet.cc:1059] Flush successful on 14171 rows (360930 bytes) I0302 15:31:46.648808 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.117s user 0.016s sys 0.004s I0302 15:31:46.650583 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:46.650616 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:46.650635 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:46.650660 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:46.650696 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 18599 or (T in {18599})}] I0302 15:31:46.651110 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:46.651356 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:46.651579 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:46.651835 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:46.726788 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72befb5feb2efea044339bc1476078588c14 I0302 15:31:46.726845 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:46.726914 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:46.726929 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 18672 or (T in {18672})}] I0302 15:31:46.732981 28368 tablet.cc:1059] Flush successful on 14148 rows (360378 bytes) I0302 15:31:46.733161 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.139s user 0.016s sys 0.003s I0302 15:31:46.767048 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6993538d058ed462db003f7115352e8e7 I0302 15:31:46.767148 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:46.769973 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:46.770011 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 18704 or (T in {18704,18707,18710})}] I0302 15:31:46.780282 28413 tablet.cc:1059] Flush successful on 15468 rows (392058 bytes) I0302 15:31:46.780447 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.131s user 0.017s sys 0.006s I0302 15:31:47.287183 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:43948/jsonmetricz I0302 15:31:47.532284 28324 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:47.532316 28324 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:47.532331 28324 compaction.cc:555] RowSet(7)(current size on disk: ~1830689 bytes) I0302 15:31:47.532347 28324 compaction.cc:555] RowSet(8)(current size on disk: ~287189 bytes) I0302 15:31:47.532359 28324 compaction.cc:555] RowSet(9)(current size on disk: ~341189 bytes) I0302 15:31:47.532382 28324 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 19532 or (T in {19532})}] I0302 15:31:47.532748 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:47.532966 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:47.533253 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:47.533540 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:47.594868 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:47.594892 28368 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:47.594902 28368 compaction.cc:555] RowSet(7)(current size on disk: ~1838777 bytes) I0302 15:31:47.594912 28368 compaction.cc:555] RowSet(8)(current size on disk: ~286805 bytes) I0302 15:31:47.594919 28368 compaction.cc:555] RowSet(9)(current size on disk: ~342389 bytes) I0302 15:31:47.594931 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 19583 or (T in {19583})}] I0302 15:31:47.595509 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:47.595840 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:47.596109 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:47.596395 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:47.650163 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:47.650192 28413 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:47.650207 28413 compaction.cc:555] RowSet(7)(current size on disk: ~1813169 bytes) I0302 15:31:47.650220 28413 compaction.cc:555] RowSet(8)(current size on disk: ~286685 bytes) I0302 15:31:47.650233 28413 compaction.cc:555] RowSet(9)(current size on disk: ~375293 bytes) I0302 15:31:47.650251 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 19638 or (T in {19638})}] I0302 15:31:47.650873 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:47.651659 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:47.652318 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:47.653764 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:47.774619 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea7326797bf7e74a8f9af3002bf59ded97 I0302 15:31:47.774698 28324 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:47.774766 28324 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:47.774807 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 19744 or (T in {19744})}] I0302 15:31:47.819634 28324 tablet.cc:1059] Compaction successful on 102405 rows (2581810 bytes) I0302 15:31:47.836999 28324 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.305s user 0.096s sys 0.021s I0302 15:31:47.923082 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bea05ee6684789409fa64566d07ddd2f71 I0302 15:31:47.923202 28368 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:47.924566 28368 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:47.924655 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 19855 or (T in {19855,19858})}] I0302 15:31:47.962108 28368 tablet.cc:1059] Compaction successful on 102776 rows (2594834 bytes) I0302 15:31:47.971252 28368 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.376s user 0.102s sys 0.024s I0302 15:31:47.983120 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b60dccc7e117304a26a444a5088286244f I0302 15:31:47.983191 28413 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:47.986227 28413 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:47.986274 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 19909 or (T in {19909,19912})}] I0302 15:31:48.020733 28413 tablet.cc:1059] Compaction successful on 103075 rows (2602010 bytes) I0302 15:31:48.025729 28413 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.376s user 0.108s sys 0.023s I0302 15:31:48.032466 28324 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:48.032490 28324 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:48.032505 28324 compaction.cc:555] RowSet(7)(current size on disk: ~1677377 bytes) I0302 15:31:48.032517 28324 compaction.cc:555] RowSet(8)(current size on disk: ~369725 bytes) I0302 15:31:48.032531 28324 compaction.cc:555] RowSet(9)(current size on disk: ~363365 bytes) I0302 15:31:48.032562 28324 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 19965 or (T in {19965})}] I0302 15:31:48.033074 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:48.033354 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:48.033610 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:48.033926 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:48.094988 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:48.095023 28368 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:48.095042 28368 compaction.cc:555] RowSet(7)(current size on disk: ~1651529 bytes) I0302 15:31:48.095064 28368 compaction.cc:555] RowSet(8)(current size on disk: ~433233 bytes) I0302 15:31:48.095093 28368 compaction.cc:555] RowSet(9)(current size on disk: ~334493 bytes) I0302 15:31:48.095124 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 20023 or (T in {20023})}] I0302 15:31:48.095896 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:48.096168 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:48.096457 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:48.096712 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:48.150280 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:48.150313 28413 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:48.150333 28413 compaction.cc:555] RowSet(7)(current size on disk: ~1659425 bytes) I0302 15:31:48.150357 28413 compaction.cc:555] RowSet(8)(current size on disk: ~402177 bytes) I0302 15:31:48.150375 28413 compaction.cc:555] RowSet(9)(current size on disk: ~365357 bytes) I0302 15:31:48.150400 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 20076 or (T in {20076})}] I0302 15:31:48.151087 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:48.151515 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:48.151765 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:48.152026 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:48.286196 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deafc25052291394f5a9ddb03c59fca7861 I0302 15:31:48.286269 28324 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:48.287345 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:43948/tablets I0302 15:31:48.288499 28324 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:48.288549 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 20207 or (T in {20207,20210})}] I0302 15:31:48.319370 28324 tablet.cc:1059] Compaction successful on 100380 rows (2533210 bytes) I0302 15:31:48.326084 28324 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.294s user 0.104s sys 0.024s I0302 15:31:48.400099 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72beaffb92e3bb4a41c6961a47e7e3dca8a7 I0302 15:31:48.400388 28368 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:48.403342 28368 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:48.403429 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 20271 or (T in {20271,20274})}] I0302 15:31:48.432381 28368 tablet.cc:1059] Compaction successful on 100746 rows (2541994 bytes) I0302 15:31:48.437402 28368 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.342s user 0.105s sys 0.019s I0302 15:31:48.444929 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6ef69b2e27e034bdeb80dd499ba05da76 I0302 15:31:48.445041 28413 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:48.445150 28413 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:48.445196 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 20310 or (T in {20310,20313})}] I0302 15:31:48.469573 28413 tablet.cc:1059] Compaction successful on 101067 rows (2549698 bytes) I0302 15:31:48.473736 28413 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.323s user 0.098s sys 0.028s I0302 15:31:48.532665 28324 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:48.532690 28324 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:48.532701 28324 compaction.cc:555] RowSet(7)(current size on disk: ~1862657 bytes) I0302 15:31:48.532713 28324 compaction.cc:555] RowSet(8)(current size on disk: ~281525 bytes) I0302 15:31:48.532724 28324 compaction.cc:555] RowSet(9)(current size on disk: ~340493 bytes) I0302 15:31:48.532739 28324 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 20412 or (T in {20412})}] I0302 15:31:48.533138 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:48.533366 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:48.533537 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:48.533735 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:48.595296 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:48.595330 28368 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:48.595350 28368 compaction.cc:555] RowSet(6)(current size on disk: ~1683881 bytes) I0302 15:31:48.595376 28368 compaction.cc:555] RowSet(7)(current size on disk: ~468945 bytes) I0302 15:31:48.595405 28368 compaction.cc:555] RowSet(8)(current size on disk: ~339941 bytes) I0302 15:31:48.595439 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 20458 or (T in {20458})}] I0302 15:31:48.596019 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:48.596293 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:48.596534 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:48.596725 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:48.650554 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:48.650579 28413 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:48.650589 28413 compaction.cc:555] RowSet(6)(current size on disk: ~1689809 bytes) I0302 15:31:48.650599 28413 compaction.cc:555] RowSet(7)(current size on disk: ~436089 bytes) I0302 15:31:48.650606 28413 compaction.cc:555] RowSet(8)(current size on disk: ~371621 bytes) I0302 15:31:48.650619 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 20507 or (T in {20507})}] I0302 15:31:48.657225 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:48.657522 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:48.657788 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:48.658004 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:48.879163 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea0322b2df1c674a1ba8fb83dec4ac7f5a I0302 15:31:48.879220 28324 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:48.883846 28324 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:48.883872 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 20666 or (T in {20666,20668})}] I0302 15:31:48.896065 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bef854144c478a47a3bcc4bfbcbba96750 I0302 15:31:48.896121 28368 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:48.896169 28368 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:48.896183 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 20669 or (T in {20669})}] I0302 15:31:48.918748 28324 tablet.cc:1059] Compaction successful on 103472 rows (2611538 bytes) I0302 15:31:48.929273 28368 tablet.cc:1059] Compaction successful on 103809 rows (2619626 bytes) I0302 15:31:48.931777 28324 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.399s user 0.096s sys 0.024s I0302 15:31:48.933998 28368 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.339s user 0.094s sys 0.025s I0302 15:31:48.939314 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6855bcba2a9734885a397e64a5f9a456b I0302 15:31:48.939427 28413 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:48.940121 28413 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:48.940170 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 20698 or (T in {20698,20701})}] I0302 15:31:48.968961 28413 tablet.cc:1059] Compaction successful on 104007 rows (2624378 bytes) I0302 15:31:48.975450 28413 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.325s user 0.100s sys 0.024s I0302 15:31:49.035996 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:49.036056 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:49.036094 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:49.036129 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:49.036173 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 20818 or (T in {20818})}] I0302 15:31:49.036635 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:49.036871 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:49.037061 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:49.037266 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:49.096807 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:49.096835 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:49.096846 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:49.096859 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:49.096881 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 20870 or (T in {20870})}] I0302 15:31:49.097303 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:49.097563 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:49.097813 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:49.098018 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:49.151120 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:49.151146 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:49.151156 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:49.151167 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:49.151183 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 20909 or (T in {20909})}] I0302 15:31:49.151473 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:49.151669 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:49.151849 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:49.152034 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:49.165349 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea2219d9e391cd4bf9b99d677af242fe49 I0302 15:31:49.165411 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:49.167147 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:49.167176 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 20929 or (T in {20929,20932})}] I0302 15:31:49.182723 28324 tablet.cc:1059] Flush successful on 15642 rows (396234 bytes) I0302 15:31:49.182940 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.150s user 0.015s sys 0.005s I0302 15:31:49.221739 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be67ede149ee574b39a5cfc875b259e9fb I0302 15:31:49.221812 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:49.222673 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:49.223278 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 20971 or (T in {20971,20974})}] I0302 15:31:49.244014 28368 tablet.cc:1059] Flush successful on 15604 rows (395322 bytes) I0302 15:31:49.244343 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.149s user 0.016s sys 0.005s I0302 15:31:49.259779 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b68d532e62afc1428196380b72a17614ab I0302 15:31:49.259830 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:49.259881 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:49.259896 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 21007 or (T in {21007})}] I0302 15:31:49.265730 28413 tablet.cc:1059] Flush successful on 15504 rows (392922 bytes) I0302 15:31:49.265892 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.115s user 0.013s sys 0.006s I0302 15:31:49.283727 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:49.283751 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:49.283766 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:49.283782 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:49.283835 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 21044 or (T in {21044})}] I0302 15:31:49.284111 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:49.284302 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:49.284514 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:49.284718 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:49.287502 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/jsonmetricz I0302 15:31:49.347806 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:49.347862 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:49.347899 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:49.347926 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:49.347955 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 21086 or (T in {21086})}] I0302 15:31:49.348265 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:49.348495 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:49.348769 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:49.349020 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:49.396601 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea6c2f4bc1c4e9420d881fb5328f9e6378 I0302 15:31:49.396723 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:49.396863 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:49.396915 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 21140 or (T in {21140})}] I0302 15:31:49.403954 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:49.403980 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:49.403992 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:49.404000 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:49.404012 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 21137 or (T in {21137})}] I0302 15:31:49.404279 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:49.404470 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:49.404655 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:49.404847 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:49.408298 28324 tablet.cc:1059] Flush successful on 15498 rows (392778 bytes) I0302 15:31:49.408720 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.126s user 0.011s sys 0.009s I0302 15:31:49.420850 28476 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:49.421313 28497 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:49.426604 28476 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000006 I0302 15:31:49.427647 28497 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000006 I0302 15:31:49.428100 28495 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:49.430029 28495 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000006 I0302 15:31:49.441313 28478 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:49.441503 28489 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:49.441707 28484 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:49.442759 28478 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000006 I0302 15:31:49.446776 28484 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000006 I0302 15:31:49.446868 28489 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000006 I0302 15:31:49.452287 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be3979ffe93a144577a0f58573f74378c1 I0302 15:31:49.452401 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:49.455147 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:49.455198 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 21173 or (T in {21173,21176,21179})}] I0302 15:31:49.466702 28368 tablet.cc:1059] Flush successful on 15410 rows (390666 bytes) I0302 15:31:49.466823 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.121s user 0.015s sys 0.004s I0302 15:31:49.489866 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6fae858ae11d64663abc939c739faf25e I0302 15:31:49.489969 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:49.492401 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:49.492450 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 21215 or (T in {21215,21218})}] I0302 15:31:49.499392 28413 tablet.cc:1059] Flush successful on 15406 rows (390570 bytes) I0302 15:31:49.499626 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.098s user 0.017s sys 0.004s I0302 15:31:49.501783 28473 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:49.502151 28496 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:49.502248 28475 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:49.503031 28496 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000006 I0302 15:31:49.503123 28475 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000006 I0302 15:31:49.503983 28473 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000006 I0302 15:31:49.533205 28324 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:49.533238 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000004 (GCed ops < 6936) I0302 15:31:49.534266 28324 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.000s I0302 15:31:49.595748 28368 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:49.595779 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000004 (GCed ops < 6956) I0302 15:31:49.596420 28368 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.000s I0302 15:31:49.651253 28413 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:49.651278 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000004 (GCed ops < 7040) I0302 15:31:49.652389 28413 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.001s I0302 15:31:49.783252 28324 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:49.783285 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000004 (GCed ops < 6168) I0302 15:31:49.784004 28324 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.001s I0302 15:31:49.845765 28368 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:49.845788 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000004 (GCed ops < 7023) I0302 15:31:49.846271 28368 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.000s I0302 15:31:49.901388 28413 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:49.901417 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000004 (GCed ops < 6200) I0302 15:31:49.902040 28413 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.000s I0302 15:31:50.033352 28324 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:50.033377 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000004 (GCed ops < 7006) I0302 15:31:50.033937 28324 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.001s I0302 15:31:50.095948 28368 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:50.095988 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000004 (GCed ops < 6188) I0302 15:31:50.096631 28368 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.000s I0302 15:31:50.151484 28413 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:50.151510 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000004 (GCed ops < 6969) I0302 15:31:50.152052 28413 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.000s I0302 15:31:50.285187 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:50.285208 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:50.285223 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:50.285231 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:50.285255 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 22179 or (T in {22179})}] I0302 15:31:50.285714 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:50.285998 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:50.286249 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:50.286469 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:50.287678 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/masterz I0302 15:31:50.346202 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:50.346230 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:50.346240 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:50.346249 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:50.346262 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 22217 or (T in {22217})}] I0302 15:31:50.346585 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:50.346802 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:50.346993 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:50.347193 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:50.390835 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea84e8e74412fd4bf0a28aa596529a15ea I0302 15:31:50.391830 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:50.395053 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:50.395119 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 22256 or (T in {22256,22260,22263})}] I0302 15:31:50.403987 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:50.404013 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:50.404026 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:50.404036 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:50.404048 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 22261 or (T in {22261})}] I0302 15:31:50.404323 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:50.404510 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:50.404743 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:50.405007 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:50.417757 28324 tablet.cc:1059] Flush successful on 20575 rows (522866 bytes) I0302 15:31:50.418068 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.135s user 0.020s sys 0.007s I0302 15:31:50.497423 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be794d25756ba74017b0bb5e02f1a6cd5d I0302 15:31:50.497505 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:50.497581 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:50.497617 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 22337 or (T in {22337})}] I0302 15:31:50.513069 28368 tablet.cc:1059] Flush successful on 20543 rows (522098 bytes) I0302 15:31:50.513228 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.167s user 0.023s sys 0.002s I0302 15:31:50.534133 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b679820655f5a74f19a199ea6aee0bc295 I0302 15:31:50.534345 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:50.535778 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:50.535836 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 22370 or (T in {22370,22373})}] I0302 15:31:50.542171 28413 tablet.cc:1059] Flush successful on 20596 rows (523370 bytes) I0302 15:31:50.542302 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.141s user 0.015s sys 0.010s I0302 15:31:51.036607 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:51.036638 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:51.036653 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:51.036669 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:51.036689 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 22966 or (T in {22966})}] I0302 15:31:51.037127 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:51.037407 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:51.037631 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:51.037840 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:51.095188 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea585f88519e5a4b7b882fc04b24004499 I0302 15:31:51.095294 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:51.097420 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:51.097473 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 23017 or (T in {23017,23020})}] I0302 15:31:51.099784 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:51.099812 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:51.099828 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:51.099853 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:51.100477 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 23012 or (T in {23012})}] I0302 15:31:51.100944 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:51.101158 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:51.101351 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:51.101534 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:51.104810 28324 tablet.cc:1059] Flush successful on 11985 rows (304346 bytes) I0302 15:31:51.105053 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.071s user 0.010s sys 0.009s I0302 15:31:51.152091 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:51.152122 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:51.152137 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:51.152148 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:51.152168 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 23051 or (T in {23051})}] I0302 15:31:51.152655 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:51.152954 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:51.153206 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:51.153496 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:51.195879 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be653c3ca64bac498383c8a9239f602f87 I0302 15:31:51.195962 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:51.197521 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:51.197579 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 23077 or (T in {23077,23080})}] I0302 15:31:51.206636 28368 tablet.cc:1059] Flush successful on 11961 rows (303770 bytes) I0302 15:31:51.206786 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.110s user 0.014s sys 0.005s I0302 15:31:51.266902 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b61688e21ce7f3454bb61106bbb4f9f326 I0302 15:31:51.266999 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:51.267065 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:51.267083 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 23135 or (T in {23135})}] I0302 15:31:51.270998 28413 tablet.cc:1059] Flush successful on 11958 rows (303698 bytes) I0302 15:31:51.271718 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.120s user 0.011s sys 0.009s I0302 15:31:51.284344 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:51.284368 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:51.284379 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:51.284389 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:51.284425 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 23161 or (T in {23161})}] I0302 15:31:51.284732 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:51.284919 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:51.285245 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:51.285449 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:51.287838 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/tablez I0302 15:31:51.342077 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deae837b62db6894afda3fa2fb36461a0fa I0302 15:31:51.342155 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:51.342241 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:51.342264 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 23210 or (T in {23210})}] I0302 15:31:51.347949 28324 tablet.cc:1059] Flush successful on 11827 rows (300554 bytes) I0302 15:31:51.348093 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.064s user 0.010s sys 0.007s I0302 15:31:51.350765 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:51.350788 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:51.350823 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:51.350854 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:51.350916 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 23206 or (T in {23206})}] I0302 15:31:51.351325 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:51.351524 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:51.351752 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:51.351953 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:51.403151 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:51.403183 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:51.403201 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:51.403218 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:51.403239 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 23254 or (T in {23254})}] I0302 15:31:51.403697 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:51.403967 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:51.404219 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:51.404486 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:51.454464 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bea68ca8a0635e4f3aa66499c26541b389 I0302 15:31:51.454613 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:51.457203 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:51.457825 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 23299 or (T in {23299,23302})}] I0302 15:31:51.465831 28368 tablet.cc:1059] Flush successful on 11857 rows (301274 bytes) I0302 15:31:51.466017 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.119s user 0.014s sys 0.003s I0302 15:31:51.471632 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6e417592e05114bf58b8ebbada9f98f31 I0302 15:31:51.471751 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:51.475036 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:51.475086 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 23315 or (T in {23315,23316})}] I0302 15:31:51.480768 28413 tablet.cc:1059] Flush successful on 11832 rows (300674 bytes) I0302 15:31:51.481073 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.079s user 0.017s sys 0.004s I0302 15:31:52.286758 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:52.286798 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:52.286815 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:52.286834 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:52.286864 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 24124 or (T in {24124})}] I0302 15:31:52.287287 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:52.287575 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:52.287830 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:52.288004 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/tablet-servers I0302 15:31:52.288112 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:52.341622 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea0f67e210829c425ca4554057b099f173 I0302 15:31:52.341680 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:52.342865 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:52.342911 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 24173 or (T in {24173,24175})}] I0302 15:31:52.347465 28324 tablet.cc:1059] Flush successful on 10884 rows (277922 bytes) I0302 15:31:52.347533 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:52.347556 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:52.347571 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:52.347573 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.063s user 0.011s sys 0.006s I0302 15:31:52.347585 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:52.347604 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 24169 or (T in {24169})}] I0302 15:31:52.348002 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:52.348269 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:52.348559 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:52.348834 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:52.403677 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:52.403700 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:52.403713 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:52.403722 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:52.403734 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 24211 or (T in {24211})}] I0302 15:31:52.404052 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:52.404294 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:52.404554 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:52.404743 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:52.449561 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bea871aa53ed2c462bb6a94287520f8580 I0302 15:31:52.449656 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:52.450502 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:52.450541 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 24249 or (T in {24249,24252})}] I0302 15:31:52.461105 28368 tablet.cc:1059] Flush successful on 10892 rows (278114 bytes) I0302 15:31:52.461745 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.114s user 0.016s sys 0.004s I0302 15:31:52.478981 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b69560334240f040bbbce53f9ccfebe663 I0302 15:31:52.479145 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:52.480962 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:52.480999 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 24279 or (T in {24279,24283})}] I0302 15:31:52.487915 28413 tablet.cc:1059] Flush successful on 10886 rows (277970 bytes) I0302 15:31:52.488052 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.085s user 0.010s sys 0.007s I0302 15:31:52.534907 28324 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:52.534936 28324 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:52.534952 28324 compaction.cc:555] RowSet(10)(current size on disk: ~2483985 bytes) I0302 15:31:52.534965 28324 compaction.cc:555] RowSet(11)(current size on disk: ~494193 bytes) I0302 15:31:52.534977 28324 compaction.cc:555] RowSet(12)(current size on disk: ~261605 bytes) I0302 15:31:52.534996 28324 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 24354 or (T in {24354})}] I0302 15:31:52.535514 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:52.535784 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:52.536144 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:52.536401 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:52.597890 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:52.597924 28368 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:52.597944 28368 compaction.cc:555] RowSet(9)(current size on disk: ~2492073 bytes) I0302 15:31:52.597957 28368 compaction.cc:555] RowSet(10)(current size on disk: ~493425 bytes) I0302 15:31:52.597971 28368 compaction.cc:555] RowSet(11)(current size on disk: ~261797 bytes) I0302 15:31:52.598006 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 24405 or (T in {24405})}] I0302 15:31:52.598569 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:52.598816 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:52.599005 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:52.599180 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:52.653440 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:52.653473 28413 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:52.653491 28413 compaction.cc:555] RowSet(9)(current size on disk: ~2496825 bytes) I0302 15:31:52.653507 28413 compaction.cc:555] RowSet(10)(current size on disk: ~494697 bytes) I0302 15:31:52.653525 28413 compaction.cc:555] RowSet(11)(current size on disk: ~261653 bytes) I0302 15:31:52.653563 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 24453 or (T in {24453})}] I0302 15:31:52.654145 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:52.654345 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:52.654520 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:52.654705 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:53.061558 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea44e22d92a0ca4491a60972ad44ec5738 I0302 15:31:53.061617 28324 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:53.064254 28324 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:53.064298 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 24683 or (T in {24683,24686})}] I0302 15:31:53.079033 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be5ad5083d609d4381809cd850c1a86cd6 I0302 15:31:53.079129 28368 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:53.079272 28368 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:53.079309 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 24681 or (T in {24681})}] I0302 15:31:53.093122 28324 tablet.cc:1059] Compaction successful on 134931 rows (3403722 bytes) I0302 15:31:53.096647 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b67e39259999d6449896581f7bbd7e46c9 I0302 15:31:53.096930 28413 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:53.100471 28413 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:53.100529 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 24689 or (T in {24689,24695,24692})}] I0302 15:31:53.101405 28324 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.567s user 0.123s sys 0.030s I0302 15:31:53.116849 28368 tablet.cc:1059] Compaction successful on 135244 rows (3411234 bytes) I0302 15:31:53.123646 28368 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.526s user 0.125s sys 0.025s I0302 15:31:53.137480 28413 tablet.cc:1059] Compaction successful on 135489 rows (3417114 bytes) I0302 15:31:53.144297 28413 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.491s user 0.139s sys 0.025s I0302 15:31:53.154044 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:53.154095 28413 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:53.154137 28413 compaction.cc:555] RowSet(10)(current size on disk: ~2474457 bytes) I0302 15:31:53.154176 28413 compaction.cc:555] RowSet(11)(current size on disk: ~370133 bytes) I0302 15:31:53.154217 28413 compaction.cc:555] RowSet(12)(current size on disk: ~284357 bytes) I0302 15:31:53.154263 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 24741 or (T in {24741})}] I0302 15:31:53.154866 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:53.155131 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:53.155387 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:53.156479 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:53.285316 28324 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:53.285344 28324 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:53.285358 28324 compaction.cc:555] RowSet(10)(current size on disk: ~2458377 bytes) I0302 15:31:53.285374 28324 compaction.cc:555] RowSet(11)(current size on disk: ~372341 bytes) I0302 15:31:53.285397 28324 compaction.cc:555] RowSet(12)(current size on disk: ~284237 bytes) I0302 15:31:53.285414 28324 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 24882 or (T in {24882})}] I0302 15:31:53.285922 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:53.286291 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:53.286623 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:53.286908 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:53.288158 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:40132/jsonmetricz I0302 15:31:53.347903 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:53.347934 28368 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:53.347949 28368 compaction.cc:555] RowSet(10)(current size on disk: ~2467281 bytes) I0302 15:31:53.347962 28368 compaction.cc:555] RowSet(11)(current size on disk: ~370229 bytes) I0302 15:31:53.347976 28368 compaction.cc:555] RowSet(12)(current size on disk: ~284957 bytes) I0302 15:31:53.348013 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 24921 or (T in {24921})}] I0302 15:31:53.348791 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:53.349068 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:53.349303 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:53.349552 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:53.460919 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b69a368a2313d14b4cbefe55989357db7c I0302 15:31:53.461025 28413 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:53.463583 28413 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:53.463620 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 24986 or (T in {24986,24988})}] I0302 15:31:53.540385 28413 tablet.cc:1059] Compaction successful on 130313 rows (3288682 bytes) I0302 15:31:53.545222 28413 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.392s user 0.126s sys 0.022s I0302 15:31:53.653607 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:53.653655 28413 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:53.653681 28413 compaction.cc:555] RowSet(10)(current size on disk: ~2426265 bytes) I0302 15:31:53.653707 28413 compaction.cc:555] RowSet(11)(current size on disk: ~372485 bytes) I0302 15:31:53.653730 28413 compaction.cc:555] RowSet(12)(current size on disk: ~287381 bytes) I0302 15:31:53.653759 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 25109 or (T in {25109})}] I0302 15:31:53.654170 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:53.655055 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:53.667433 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:53.667649 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:53.759346 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be115f3c5a624a4a429af5f27df6e6347d I0302 15:31:53.759450 28368 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:53.760854 28368 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:53.760886 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 25173 or (T in {25173,25176})}] I0302 15:31:53.770148 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dead1afebaaa757440ebcb14c78289da6f4 I0302 15:31:53.770241 28324 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:53.770910 28324 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:53.770943 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 25194 or (T in {25194,25197})}] I0302 15:31:53.797327 28368 tablet.cc:1059] Compaction successful on 130043 rows (3282202 bytes) I0302 15:31:53.805259 28324 tablet.cc:1059] Compaction successful on 129730 rows (3270570 bytes) I0302 15:31:53.807494 28368 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.460s user 0.130s sys 0.035s I0302 15:31:53.810652 28324 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.525s user 0.138s sys 0.027s I0302 15:31:53.848057 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:53.848101 28368 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:53.848129 28368 compaction.cc:555] RowSet(10)(current size on disk: ~2418561 bytes) I0302 15:31:53.848155 28368 compaction.cc:555] RowSet(11)(current size on disk: ~374885 bytes) I0302 15:31:53.848179 28368 compaction.cc:555] RowSet(12)(current size on disk: ~287453 bytes) I0302 15:31:53.848208 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 25255 or (T in {25255})}] I0302 15:31:53.848688 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:53.848947 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:53.849318 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:53.849648 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:53.940346 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6d59ab141729e454f835e75a375829585 I0302 15:31:53.940428 28413 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:53.940501 28413 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:53.940533 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 25335 or (T in {25335})}] I0302 15:31:53.979815 28413 tablet.cc:1059] Compaction successful on 128529 rows (3241746 bytes) I0302 15:31:53.986208 28413 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.333s user 0.132s sys 0.031s I0302 15:31:54.000861 28497 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:54.001356 28476 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:54.002935 28476 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000007 I0302 15:31:54.003998 28497 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000007 I0302 15:31:54.004528 28495 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:54.006527 28495 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000007 I0302 15:31:54.034194 28478 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:54.035608 28484 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:54.035675 28324 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:54.035697 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000005 (GCed ops < 7712) I0302 15:31:54.036059 28489 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:54.036406 28324 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.001s sys 0.000s I0302 15:31:54.036633 28478 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000007 I0302 15:31:54.038444 28484 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000007 I0302 15:31:54.039170 28489 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000007 I0302 15:31:54.065829 28473 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:54.066727 28475 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:54.067425 28496 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:54.067911 28496 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000007 I0302 15:31:54.068495 28473 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000007 I0302 15:31:54.071357 28475 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000007 I0302 15:31:54.141139 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bead4442d8f88a4c5bb47839c7997b3c95 I0302 15:31:54.141310 28368 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:54.144387 28368 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:54.144426 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 25530 or (T in {25530,25533,25536})}] I0302 15:31:54.153847 28413 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:54.153872 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000005 (GCed ops < 7682) I0302 15:31:54.154405 28413 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.001s sys 0.000s I0302 15:31:54.176837 28368 tablet.cc:1059] Compaction successful on 128311 rows (3236514 bytes) I0302 15:31:54.184617 28368 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.337s user 0.124s sys 0.034s I0302 15:31:54.285895 28324 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:54.285930 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000005 (GCed ops < 7650) I0302 15:31:54.286646 28324 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.000s I0302 15:31:54.288314 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:40132/tablets I0302 15:31:54.348266 28368 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:54.348290 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000005 (GCed ops < 7669) I0302 15:31:54.348901 28368 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.000s I0302 15:31:54.403970 28413 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:54.403997 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000005 (GCed ops < 8075) I0302 15:31:54.404770 28413 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.000s I0302 15:31:54.535913 28324 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:54.535979 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000005 (GCed ops < 8042) I0302 15:31:54.536638 28324 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.000s I0302 15:31:54.598734 28368 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:54.598767 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000005 (GCed ops < 7730) I0302 15:31:54.599391 28368 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.000s I0302 15:31:54.654116 28413 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:54.654139 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000005 (GCed ops < 7746) I0302 15:31:54.654650 28413 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.000s I0302 15:31:54.786069 28324 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:54.786100 28324 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:54.786118 28324 compaction.cc:555] RowSet(10)(current size on disk: ~2409777 bytes) I0302 15:31:54.786133 28324 compaction.cc:555] RowSet(11)(current size on disk: ~375797 bytes) I0302 15:31:54.786149 28324 compaction.cc:555] RowSet(12)(current size on disk: ~288029 bytes) I0302 15:31:54.786170 28324 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 26245 or (T in {26245})}] I0302 15:31:54.786819 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:54.787048 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:54.787359 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:54.787629 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:54.849354 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:54.849385 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:54.849400 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:54.849412 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:54.849432 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 26298 or (T in {26298})}] I0302 15:31:54.849964 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:54.850250 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:54.850498 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:54.850724 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:54.904289 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:54.904320 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:54.904331 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:54.904340 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:54.904352 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 26345 or (T in {26345})}] I0302 15:31:54.904670 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:54.904904 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:54.905087 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:54.905287 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:54.958246 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bec75dde950c4547139c428a3c6b050c76 I0302 15:31:54.958328 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:54.963191 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:54.963219 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 26383 or (T in {26383,26389,26386})}] I0302 15:31:54.975831 28368 tablet.cc:1059] Flush successful on 18491 rows (468730 bytes) I0302 15:31:54.976054 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.127s user 0.021s sys 0.004s I0302 15:31:55.101989 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:55.102015 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:55.102032 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:55.102049 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:55.102071 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 26491 or (T in {26491})}] I0302 15:31:55.102444 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:55.102663 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:55.102892 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:55.103070 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:55.111737 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6654790b613054f94b64ae19aec5cde7b I0302 15:31:55.111793 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:55.111850 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:55.111865 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 26496 or (T in {26496})}] I0302 15:31:55.121107 28413 tablet.cc:1059] Flush successful on 18531 rows (469690 bytes) I0302 15:31:55.121489 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.217s user 0.016s sys 0.009s I0302 15:31:55.122143 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea87fb1b5d8e16471db251cc1cd544cdff I0302 15:31:55.122243 28324 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:55.125030 28324 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:55.125061 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 26515 or (T in {26515,26521,26517})}] I0302 15:31:55.155678 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:55.155721 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:55.155750 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:55.155778 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:55.155820 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 26537 or (T in {26537})}] I0302 15:31:55.156172 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:55.156384 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:55.156586 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:55.157133 28324 tablet.cc:1059] Compaction successful on 128007 rows (3229218 bytes) I0302 15:31:55.158304 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:55.164140 28324 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.378s user 0.112s sys 0.043s I0302 15:31:55.201617 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be353c8d7b29b34b0db56c98257439152a I0302 15:31:55.201669 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:55.203258 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:55.203286 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 26575 or (T in {26575,26578})}] I0302 15:31:55.210886 28368 tablet.cc:1059] Flush successful on 18333 rows (464938 bytes) I0302 15:31:55.211045 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.112s user 0.015s sys 0.007s I0302 15:31:55.267416 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b67d29c2357ea7496e93d39f39fa8ea3d8 I0302 15:31:55.267495 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:55.269487 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:55.269534 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 26630 or (T in {26630,26633})}] I0302 15:31:55.275665 28413 tablet.cc:1059] Flush successful on 18343 rows (465178 bytes) I0302 15:31:55.275840 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.122s user 0.017s sys 0.005s I0302 15:31:55.288195 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:55.288230 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:55.288257 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:55.288280 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:55.288331 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 26667 or (T in {26667})}] I0302 15:31:55.288542 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:55689/jsonmetricz I0302 15:31:55.288795 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:55.289053 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:55.289284 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:55.289540 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:55.348901 28368 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:55.348922 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000005 (GCed ops < 8061) I0302 15:31:55.351549 28368 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.003s user 0.000s sys 0.000s I0302 15:31:55.405226 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:55.405263 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:55.405282 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:55.405308 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:55.405338 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 26742 or (T in {26742})}] I0302 15:31:55.405787 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:55.406072 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:55.406255 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:55.406442 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:55.407826 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea2eb1409ff2ec456eb67f5eea448aeb79 I0302 15:31:55.407876 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:55.409427 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:55.409467 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 26757 or (T in {26757,26760})}] I0302 15:31:55.415546 28324 tablet.cc:1059] Flush successful on 20755 rows (527186 bytes) I0302 15:31:55.415801 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.129s user 0.022s sys 0.005s I0302 15:31:55.469166 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6d0b6caf689d0408287570ee35a54a570 I0302 15:31:55.469247 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:55.471205 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:55.471249 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 26803 or (T in {26803,26805})}] I0302 15:31:55.479761 28413 tablet.cc:1059] Flush successful on 13984 rows (356442 bytes) I0302 15:31:55.479918 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.075s user 0.012s sys 0.007s I0302 15:31:55.537399 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:55.537434 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:55.537469 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:55.537489 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:55.537572 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 26894 or (T in {26894})}] I0302 15:31:55.537951 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:55.538154 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:55.538337 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:55.538581 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:55.599053 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:55.599079 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:55.599089 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:55.599097 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:55.599109 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 26948 or (T in {26948})}] I0302 15:31:55.599484 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:55.599766 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:55.600512 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:55.600894 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:55.602216 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deae9997c965f2f4b7caac06da1e63bc005 I0302 15:31:55.602285 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:55.602365 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:55.602386 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 26964 or (T in {26964})}] I0302 15:31:55.609344 28324 tablet.cc:1059] Flush successful on 20835 rows (529106 bytes) I0302 15:31:55.609550 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.073s user 0.021s sys 0.005s I0302 15:31:55.685185 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be2bb5017ed16a42b98172c87a284dbc6b I0302 15:31:55.685286 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:55.686177 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:55.686228 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 27032 or (T in {27032,27035})}] I0302 15:31:55.692456 28368 tablet.cc:1059] Flush successful on 15345 rows (389106 bytes) I0302 15:31:55.692630 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.094s user 0.014s sys 0.007s I0302 15:31:55.787631 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:55.787659 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:55.787678 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:55.787691 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:55.787747 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 27165 or (T in {27165})}] I0302 15:31:55.788136 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:55.788444 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:55.788709 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:55.788993 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:55.890249 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea83cdf644557f408f9285368e15c73ba2 I0302 15:31:55.890349 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:55.892681 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:55.892746 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 27278 or (T in {27278,27282})}] I0302 15:31:55.896646 28324 tablet.cc:1059] Flush successful on 16789 rows (423762 bytes) I0302 15:31:55.896760 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.110s user 0.014s sys 0.007s I0302 15:31:56.288693 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:55689/tablets I0302 15:31:56.852198 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:56.852231 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:56.852252 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:56.852264 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:56.852303 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 28418 or (T in {28418})}] I0302 15:31:56.852696 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:56.852916 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:56.853144 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:56.853348 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:56.902469 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bef585995b307447f693b55fc62f93290f I0302 15:31:56.902523 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:56.903877 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:56.903916 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 28467 or (T in {28467,28470})}] I0302 15:31:56.905467 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:56.905485 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:56.905503 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:56.905517 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:56.905537 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 28467 or (T in {28467})}] I0302 15:31:56.905918 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:56.906236 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:56.907193 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:56.907428 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:56.917382 28368 tablet.cc:1059] Flush successful on 11872 rows (301634 bytes) I0302 15:31:56.917520 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.068s user 0.011s sys 0.006s I0302 15:31:56.959722 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b66ffb4ca7d00a46e3a88582582f2b2043 I0302 15:31:56.959838 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:56.960103 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:56.960139 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 28527 or (T in {28527})}] I0302 15:31:56.963845 28413 tablet.cc:1059] Flush successful on 11911 rows (302570 bytes) I0302 15:31:56.964031 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.059s user 0.012s sys 0.005s I0302 15:31:57.038365 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:57.038400 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:57.038415 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:57.038430 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:57.038452 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 28630 or (T in {28630})}] I0302 15:31:57.038846 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:57.039104 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:57.039371 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:57.039638 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:57.095844 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deaba46ca42ebcd4a1393befa73e433599a I0302 15:31:57.095924 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:57.097765 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:57.097820 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 28686 or (T in {28686,28689})}] I0302 15:31:57.101130 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:57.101148 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:57.101158 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:57.101169 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:57.101182 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 28678 or (T in {28678})}] I0302 15:31:57.101943 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:57.102210 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:57.102530 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:57.103339 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:57.103585 28324 tablet.cc:1059] Flush successful on 11058 rows (282098 bytes) I0302 15:31:57.103694 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.066s user 0.012s sys 0.004s I0302 15:31:57.153203 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be5c54cf76eca34d55a1abc4107ce9c10d I0302 15:31:57.153306 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:57.156487 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:57.156507 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:57.156517 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:57.156533 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:57.156589 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:57.156595 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 28735 or (T in {28735})}] I0302 15:31:57.156637 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 28733 or (T in {28733,28736,28739})}] I0302 15:31:57.156906 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:57.157096 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:57.157258 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:57.157513 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:57.165781 28368 tablet.cc:1059] Flush successful on 12277 rows (311354 bytes) I0302 15:31:57.166333 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.066s user 0.009s sys 0.008s I0302 15:31:57.239161 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6dd4b592496704326902e9b1a21462ad1 I0302 15:31:57.239220 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:57.241591 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:57.241642 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 28807 or (T in {28807,28810,28813})}] I0302 15:31:57.245637 28413 tablet.cc:1059] Flush successful on 12326 rows (312530 bytes) I0302 15:31:57.245844 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.090s user 0.015s sys 0.002s I0302 15:31:57.288136 28324 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:57.288162 28324 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:57.288190 28324 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:57.288207 28324 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:57.288236 28324 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 28885 or (T in {28885})}] I0302 15:31:57.288604 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:57.288790 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:57.288812 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:43948/jsonmetricz I0302 15:31:57.288986 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:57.289194 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:57.355744 28368 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:57.355780 28368 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:57.355798 28368 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:57.355810 28368 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:57.355824 28368 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 28931 or (T in {28931})}] I0302 15:31:57.356124 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:57.356370 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:57.356616 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:57.356887 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:57.369695 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deab4e26263bf2f48a2a4fd5b624d91fe55 I0302 15:31:57.369869 28324 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:57.369999 28324 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:57.370044 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 28954 or (T in {28954})}] I0302 15:31:57.385612 28324 tablet.cc:1059] Flush successful on 11161 rows (284570 bytes) I0302 15:31:57.386255 28324 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.098s user 0.007s sys 0.009s I0302 15:31:57.406383 28413 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:31:57.406409 28413 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:31:57.406424 28413 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:31:57.406438 28413 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:31:57.406461 28413 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 28973 or (T in {28973})}] I0302 15:31:57.408797 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:57.408998 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:57.409180 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:57.409368 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:57.498989 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be703d934a07a54340b3b849272c7f123c I0302 15:31:57.499042 28368 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:57.500752 28368 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:57.500784 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 29048 or (T in {29048,29051})}] I0302 15:31:57.509627 28368 tablet.cc:1059] Flush successful on 11031 rows (281450 bytes) I0302 15:31:57.509716 28368 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.160s user 0.013s sys 0.005s I0302 15:31:57.524912 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6754fa259317a4abfa7f2b2ae8fb8c4ed I0302 15:31:57.525038 28413 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:57.528004 28413 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:57.528033 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 29066 or (T in {29066,29070})}] I0302 15:31:57.532256 28413 tablet.cc:1059] Flush successful on 12442 rows (315314 bytes) I0302 15:31:57.532448 28413 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.127s user 0.013s sys 0.005s I0302 15:31:57.537837 28324 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:57.537856 28324 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:57.537866 28324 compaction.cc:555] RowSet(13)(current size on disk: ~3114177 bytes) I0302 15:31:57.537875 28324 compaction.cc:555] RowSet(14)(current size on disk: ~500433 bytes) I0302 15:31:57.537883 28324 compaction.cc:555] RowSet(15)(current size on disk: ~268253 bytes) I0302 15:31:57.537895 28324 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 29097 or (T in {29097})}] I0302 15:31:57.538250 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:57.538442 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:57.538705 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:57.539022 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:57.600747 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:57.600778 28368 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:57.600798 28368 compaction.cc:555] RowSet(12)(current size on disk: ~3246601 bytes) I0302 15:31:57.600818 28368 compaction.cc:555] RowSet(13)(current size on disk: ~368669 bytes) I0302 15:31:57.600839 28368 compaction.cc:555] RowSet(14)(current size on disk: ~265133 bytes) I0302 15:31:57.600870 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 29157 or (T in {29157})}] I0302 15:31:57.601320 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:57.601572 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:57.601863 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:57.602063 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:57.655879 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:57.655910 28413 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:57.655926 28413 compaction.cc:555] RowSet(13)(current size on disk: ~3128169 bytes) I0302 15:31:57.655939 28413 compaction.cc:555] RowSet(14)(current size on disk: ~440625 bytes) I0302 15:31:57.655952 28413 compaction.cc:555] RowSet(15)(current size on disk: ~296213 bytes) I0302 15:31:57.655972 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 29208 or (T in {29208})}] I0302 15:31:57.656498 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:57.656736 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:57.656960 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:57.657253 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:57.967712 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea2d7431b6bf064aa2a1d05d2f528ad249 I0302 15:31:57.967792 28324 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:57.967872 28324 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:57.968411 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 29416 or (T in {29416})}] I0302 15:31:58.076856 28324 tablet.cc:1059] Compaction successful on 161726 rows (4079762 bytes) I0302 15:31:58.092733 28324 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.555s user 0.147s sys 0.029s I0302 15:31:58.102668 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be72a54de22165444091e572d1415cbc7c I0302 15:31:58.102721 28368 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:58.102855 28368 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:58.102890 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 29515 or (T in {29515})}] I0302 15:31:58.132860 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6e1e0289b14fc4d739f6ab75e5a218947 I0302 15:31:58.133003 28413 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:58.133633 28413 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:58.133669 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 29535 or (T in {29535,29539})}] I0302 15:31:58.143245 28368 tablet.cc:1059] Compaction successful on 161620 rows (4077218 bytes) I0302 15:31:58.151726 28368 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.551s user 0.158s sys 0.028s I0302 15:31:58.178442 28413 tablet.cc:1059] Compaction successful on 160982 rows (4061906 bytes) I0302 15:31:58.185012 28413 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.529s user 0.147s sys 0.032s I0302 15:31:58.211612 28476 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:58.211987 28497 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:58.212803 28497 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000008 I0302 15:31:58.213098 28476 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000008 I0302 15:31:58.214887 28495 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:58.215602 28495 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000008 I0302 15:31:58.253303 28478 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:58.253564 28484 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:58.253792 28489 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:58.254575 28484 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000008 I0302 15:31:58.254844 28478 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000008 I0302 15:31:58.256779 28489 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000008 I0302 15:31:58.280663 28473 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:58.280956 28496 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:58.281600 28475 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:31:58.282400 28473 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000008 I0302 15:31:58.283980 28496 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000008 I0302 15:31:58.284409 28475 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000008 I0302 15:31:58.288147 28324 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:58.288164 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000006 (GCed ops < 9537) I0302 15:31:58.288681 28324 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.001s I0302 15:31:58.289054 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:43948/tablets I0302 15:31:58.350561 28368 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:58.350586 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000006 (GCed ops < 9470) I0302 15:31:58.351191 28368 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.001s I0302 15:31:58.369760 28280 linked_list-test-util.h:402] Written 500000 rows in chain ------------------------------------------------------------ Histogram for latency of insert operations (microseconds) Note: each insert is a batch of 50 rows. ------------------------------------------------------------ Count: 10000 Mean: 2480.42 Percentiles: 0% (min) = 1156 25% = 2048 50% (med) = 2218 75% = 2450 95% = 3588 99% = 7920 99.9% = 23168 99.99% = 44032 100% (max) = 109102 I0302 15:31:58.406189 28413 log_reader.cc:396] T 36005aaac18b4c70b2fc03d1382ca7c3: removed 1 log segments from log reader I0302 15:31:58.406219 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000006 (GCed ops < 9488) I0302 15:31:58.406785 28413 maintenance_manager.cc:316] Time spent running LogGCOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.001s user 0.000s sys 0.001s I0302 15:31:58.538275 28324 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:58.538307 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000006 (GCed ops < 9624) I0302 15:31:58.538908 28324 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.001s I0302 15:31:58.600744 28368 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:58.600772 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000006 (GCed ops < 9559) I0302 15:31:58.601428 28368 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.000s I0302 15:31:58.656345 28413 log_reader.cc:396] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: removed 1 log segments from log reader I0302 15:31:58.656380 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000006 (GCed ops < 9579) I0302 15:31:58.656985 28413 maintenance_manager.cc:316] Time spent running LogGCOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.001s user 0.000s sys 0.001s I0302 15:31:58.788379 28324 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:58.788404 28324 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000006 (GCed ops < 9050) I0302 15:31:58.789120 28324 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.001s I0302 15:31:58.850813 28368 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:58.850839 28368 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000006 (GCed ops < 9640) I0302 15:31:58.851502 28368 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.000s I0302 15:31:58.906450 28413 log_reader.cc:396] T ad1251b8988446ffa0348b542d353bd4: removed 1 log segments from log reader I0302 15:31:58.906479 28413 log.cc:623] Deleting log segment in path: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000006 (GCed ops < 9655) I0302 15:31:58.907081 28413 maintenance_manager.cc:316] Time spent running LogGCOp(ad1251b8988446ffa0348b542d353bd4): real 0.001s user 0.000s sys 0.001s I0302 15:31:59.038624 28324 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:59.038661 28324 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:59.038729 28324 compaction.cc:555] RowSet(13)(current size on disk: ~3072825 bytes) I0302 15:31:59.038758 28324 compaction.cc:555] RowSet(14)(current size on disk: ~498513 bytes) I0302 15:31:59.038779 28324 compaction.cc:555] RowSet(15)(current size on disk: ~265781 bytes) I0302 15:31:59.038812 28324 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 30615 or (T in {30615})}] I0302 15:31:59.039813 28324 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:59.040027 28324 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:59.040313 28324 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:59.040582 28324 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:59.101068 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:59.101109 28368 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:59.101131 28368 compaction.cc:555] RowSet(13)(current size on disk: ~3121689 bytes) I0302 15:31:59.101161 28368 compaction.cc:555] RowSet(14)(current size on disk: ~440385 bytes) I0302 15:31:59.101178 28368 compaction.cc:555] RowSet(15)(current size on disk: ~295037 bytes) I0302 15:31:59.101212 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 30666 or (T in {30666})}] I0302 15:31:59.101763 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:59.101968 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:59.102236 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:59.102419 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:59.156744 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:59.156776 28413 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:59.156792 28413 compaction.cc:555] RowSet(12)(current size on disk: ~3252481 bytes) I0302 15:31:59.156805 28413 compaction.cc:555] RowSet(13)(current size on disk: ~336005 bytes) I0302 15:31:59.156817 28413 compaction.cc:555] RowSet(14)(current size on disk: ~298997 bytes) I0302 15:31:59.156836 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 30720 or (T in {30720})}] I0302 15:31:59.157811 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:59.158130 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:59.158366 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:59.158550 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:59.283243 28280 linked_list-test-util.h:407] Finished inserting list. Added 517150 in chain I0302 15:31:59.283290 28280 linked_list-test-util.h:408] Last entries inserted had keys: I0302 15:31:59.283314 28280 linked_list-test-util.h:410] 0: 323495273466835968 I0302 15:31:59.283336 28280 linked_list-test-util.h:410] 1: 14056083109460633345 I0302 15:31:59.283359 28280 linked_list-test-util.h:410] 2: 9341926321989064962 I0302 15:31:59.283381 28280 linked_list-test-util.h:410] 3: 4627768984761682947 I0302 15:31:59.283403 28280 linked_list-test-util.h:410] 4: 237108020512764676 I0302 15:31:59.283426 28280 linked_list-test-util.h:410] 5: 13969694756994934277 I0302 15:31:59.283447 28280 linked_list-test-util.h:410] 6: 9255538519279180038 I0302 15:31:59.283469 28280 linked_list-test-util.h:410] 7: 4541381182051798023 I0302 15:31:59.283491 28280 linked_list-test-util.h:410] 8: 150720217802879752 I0302 15:31:59.283514 28280 linked_list-test-util.h:410] 9: 13883306954285049353 I0302 15:31:59.283535 28280 linked_list-test-util.h:410] 10: 9169150166813480970 I0302 15:31:59.283558 28280 linked_list-test-util.h:410] 11: 4454992829586098955 I0302 15:31:59.283581 28280 linked_list-test-util.h:410] 12: 64332964848808460 I0302 15:31:59.283603 28280 linked_list-test-util.h:410] 13: 13796919701330978061 I0302 15:31:59.283638 28280 linked_list-test-util.h:410] 14: 9082762364103596046 I0302 15:31:59.283659 28280 linked_list-test-util.h:410] 15: 4368605026876214031 I0302 15:31:59.283681 28280 linked_list-test-util.h:410] 16: 18424688136336847376 I0302 15:31:59.283704 28280 linked_list-test-util.h:410] 17: 13710530799109465361 I0302 15:31:59.283726 28280 linked_list-test-util.h:410] 18: 8996375111149524754 I0302 15:31:59.283748 28280 linked_list-test-util.h:410] 19: 4282217773922142739 I0302 15:31:59.283771 28280 linked_list-test-util.h:410] 20: 18338300883382776084 I0302 15:31:59.283792 28280 linked_list-test-util.h:410] 21: 13624143546155394069 I0302 15:31:59.283814 28280 linked_list-test-util.h:410] 22: 8909986208928012054 I0302 15:31:59.283836 28280 linked_list-test-util.h:410] 23: 4195828871700630039 I0302 15:31:59.283859 28280 linked_list-test-util.h:410] 24: 18251913080672891160 I0302 15:31:59.283880 28280 linked_list-test-util.h:410] 25: 13537755743445509145 I0302 15:31:59.283902 28280 linked_list-test-util.h:410] 26: 8823598406218127130 I0302 15:31:59.283926 28280 linked_list-test-util.h:410] 27: 4432937441969208859 I0302 15:31:59.283948 28280 linked_list-test-util.h:410] 28: 18165524728207192092 I0302 15:31:59.283970 28280 linked_list-test-util.h:410] 29: 13451368490491437853 I0302 15:31:59.283993 28280 linked_list-test-util.h:410] 30: 8737211153264055838 I0302 15:31:59.284014 28280 linked_list-test-util.h:410] 31: 4346550189015137567 I0302 15:31:59.284036 28280 linked_list-test-util.h:410] 32: 18079136925497307168 I0302 15:31:59.284060 28280 linked_list-test-util.h:410] 33: 13364979588269925153 I0302 15:31:59.284081 28280 linked_list-test-util.h:410] 34: 8650822251042543138 I0302 15:31:59.284103 28280 linked_list-test-util.h:410] 35: 4260162386305252643 I0302 15:31:59.284126 28280 linked_list-test-util.h:410] 36: 17992749672543235876 I0302 15:31:59.284147 28280 linked_list-test-util.h:410] 37: 13278592335315853861 I0302 15:31:59.284169 28280 linked_list-test-util.h:410] 38: 8564434998088471846 I0302 15:31:59.284211 28280 linked_list-test-util.h:410] 39: 4173774033839553575 I0302 15:31:59.284236 28280 linked_list-test-util.h:410] 40: 17906360770321723176 I0302 15:31:59.284258 28280 linked_list-test-util.h:410] 41: 13192204532605968937 I0302 15:31:59.284281 28280 linked_list-test-util.h:410] 42: 8478047195378586922 I0302 15:31:59.284303 28280 linked_list-test-util.h:410] 43: 4087386231129668651 I0302 15:31:59.284325 28280 linked_list-test-util.h:410] 44: 17819973517367651884 I0302 15:31:59.284348 28280 linked_list-test-util.h:410] 45: 13105816180140269869 I0302 15:31:59.284370 28280 linked_list-test-util.h:410] 46: 8391658842912887854 I0302 15:31:59.284392 28280 linked_list-test-util.h:410] 47: 4000998978175597359 I0302 15:31:59.284415 28280 linked_list-test-util.h:410] 48: 17733585714657766960 I0302 15:31:59.284437 28280 linked_list-test-util.h:410] 49: 13019428377430384945 I0302 15:31:59.289201 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/jsonmetricz I0302 15:31:59.357300 28280 linked_list-test-util.h:656] Done collecting results (517138 rows in 59.2146ms) I0302 15:31:59.364913 28324 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea9bd1cf650f6841ea921cc25b115b7599 I0302 15:31:59.365021 28324 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:59.424162 28280 linked_list-test-util.h:571] Table not yet ready: 517138/517150 rows (status: Illegal state: Missing rows, but with no broken link in the chain. This means that a suffix of the inserted rows went missing. Expected=517150, seen=517138.) I0302 15:31:59.483878 28280 linked_list-test-util.h:656] Done collecting results (517116 rows in 34.7941ms) I0302 15:31:59.517604 28368 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72beb08e33164a81448e9f5ec5c5ca811276 I0302 15:31:59.517668 28368 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:59.530287 28413 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b627d873184b28487489260eb509383a6d I0302 15:31:59.530359 28413 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:31:59.546021 28280 linked_list-test-util.h:571] Table not yet ready: 517116/517150 rows (status: Illegal state: Missing rows, but with no broken link in the chain. This means that a suffix of the inserted rows went missing. Expected=517150, seen=517116.) I0302 15:31:59.613235 28280 linked_list-test-util.h:656] Done collecting results (517128 rows in 43.4047ms) I0302 15:31:59.692385 28280 linked_list-test-util.h:571] Table not yet ready: 517128/517150 rows (status: Illegal state: Missing rows, but with no broken link in the chain. This means that a suffix of the inserted rows went missing. Expected=517150, seen=517128.) I0302 15:31:59.749912 28280 linked_list-test-util.h:656] Done collecting results (517112 rows in 32.1478ms) I0302 15:31:59.782680 28413 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:59.782714 28413 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 30828 or (T in {30828,30832})}] I0302 15:31:59.782801 28368 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:59.782822 28368 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 30834 or (T in {30834,30837})}] I0302 15:31:59.782855 28324 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:31:59.782876 28324 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 30845 or (T in {30845,30848})}] I0302 15:31:59.813168 28368 tablet.cc:1059] Compaction successful on 160653 rows (4049890 bytes) I0302 15:31:59.814604 28280 linked_list-test-util.h:571] Table not yet ready: 517112/517150 rows (status: Illegal state: Missing rows, but with no broken link in the chain. This means that a suffix of the inserted rows went missing. Expected=517150, seen=517112.) I0302 15:31:59.817852 28413 tablet.cc:1059] Compaction successful on 161915 rows (4084298 bytes) I0302 15:31:59.817873 28324 tablet.cc:1059] Compaction successful on 159820 rows (4029898 bytes) I0302 15:31:59.819548 28368 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.719s user 0.144s sys 0.033s I0302 15:31:59.821606 28413 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.665s user 0.143s sys 0.032s I0302 15:31:59.822089 28324 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.784s user 0.147s sys 0.032s I0302 15:31:59.851356 28368 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:59.851408 28368 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:59.851887 28368 compaction.cc:555] RowSet(13)(current size on disk: ~3080121 bytes) I0302 15:31:59.851920 28368 compaction.cc:555] RowSet(14)(current size on disk: ~444177 bytes) I0302 15:31:59.851946 28368 compaction.cc:555] RowSet(15)(current size on disk: ~285317 bytes) I0302 15:31:59.851976 28368 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 30836 or (T in {30836})}] I0302 15:31:59.852424 28368 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:59.852629 28368 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:59.852841 28368 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:59.853039 28368 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:59.879395 28280 linked_list-test-util.h:656] Done collecting results (517150 rows in 40.7983ms) I0302 15:31:59.906980 28413 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:31:59.907029 28413 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:31:59.907064 28413 compaction.cc:555] RowSet(13)(current size on disk: ~3085353 bytes) I0302 15:31:59.907102 28413 compaction.cc:555] RowSet(14)(current size on disk: ~445137 bytes) I0302 15:31:59.907138 28413 compaction.cc:555] RowSet(15)(current size on disk: ~286253 bytes) I0302 15:31:59.907183 28413 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 30830 or (T in {30830})}] I0302 15:31:59.907773 28413 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:31:59.908067 28413 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:31:59.908351 28413 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:31:59.908622 28413 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:31:59.941745 28280 linked_list-test-util.h:585] Successfully verified 517150 rows I0302 15:31:59.944679 28280 linked_list-test.cc:147] Successfully verified 517150 rows before killing any servers. I0302 15:31:59.946569 28280 linked_list-test.cc:154] Killing TS: 892c1da145ed4847b1dfd57983516d8f, leader of tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 and verifying that we can still read all results I0302 15:31:59.946604 28280 external_mini_cluster.cc:446] Killing /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server with pid 28315 W0302 15:31:59.984426 28280 meta_cache.cc:164] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Replica 892c1da145ed4847b1dfd57983516d8f has failed: Network error: TS failed: Client connection negotiation failed: client Connection to 127.0.0.1:7050: connect: Connection refused (error 111) W0302 15:31:59.984483 28280 meta_cache.cc:164] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Replica 892c1da145ed4847b1dfd57983516d8f has failed: Network error: TS failed: Client connection negotiation failed: client Connection to 127.0.0.1:7050: connect: Connection refused (error 111) W0302 15:31:59.984521 28280 meta_cache.cc:164] Tablet ad1251b8988446ffa0348b542d353bd4: Replica 892c1da145ed4847b1dfd57983516d8f has failed: Network error: TS failed: Client connection negotiation failed: client Connection to 127.0.0.1:7050: connect: Connection refused (error 111) I0302 15:31:59.995348 28280 linked_list-test-util.h:656] Done collecting results (517150 rows in 31.3614ms) I0302 15:32:00.068558 28280 linked_list-test-util.h:585] Successfully verified 517150 rows I0302 15:32:00.069382 28280 external_mini_cluster.cc:446] Killing /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server with pid 28367 I0302 15:32:00.093940 28280 external_mini_cluster.cc:446] Killing /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server with pid 28410 I0302 15:32:00.111704 28280 external_mini_cluster.cc:382] Running /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server kudu-tablet_server --tablet_server_wal_dir=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0 --tablet_server_data_dirs=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0 --tablet_server_rpc_bind_addresses=127.0.0.1:7050 --tablet_server_web_port=40132 --tablet_server_master_addrs=127.0.0.1:50914 --skip_remove_old_recovery_dir --enable_leader_failure_detection=true --tablet_server_rpc_bind_addresses=127.0.0.1:7050 --flush_threshold_mb=1 --log_segment_size_mb=1 --server_dump_info_path=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/info.pb --server_dump_info_format=pb --logtostderr --logbuflevel=-1 --webserver_interface=localhost WARNING: Perftools heap leak checker is active -- Performance may suffer I0302 15:32:00.136961 29777 tablet_server_main.cc:38] Initializing tablet server... I0302 15:32:00.138902 29777 fs_manager.cc:132] Opened local filesystem: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0 uuid: "892c1da145ed4847b1dfd57983516d8f" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:32:00.141608 29777 ts_tablet_manager.cc:285] Loading master block 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:00.142941 29777 ts_tablet_manager.cc:449] Registered tablet 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:00.143054 29777 ts_tablet_manager.cc:285] Loading master block ad1251b8988446ffa0348b542d353bd4 I0302 15:32:00.143076 29783 ts_tablet_manager.cc:314] Bootstrapping tablet: 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:00.145362 29777 ts_tablet_manager.cc:449] Registered tablet ad1251b8988446ffa0348b542d353bd4 I0302 15:32:00.145449 29783 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap starting. I0302 15:32:00.145648 29777 ts_tablet_manager.cc:285] Loading master block 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:00.145669 29784 ts_tablet_manager.cc:314] Bootstrapping tablet: ad1251b8988446ffa0348b542d353bd4 I0302 15:32:00.147007 29783 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea9bd1cf650f6841ea921cc25b115b7599 I0302 15:32:00.147480 29783 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000008 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008 I0302 15:32:00.147531 29783 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000007 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000007 I0302 15:32:00.147604 29783 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery W0302 15:32:00.148205 29783 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:00.148241 29783 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:00.149369 29784 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap starting. I0302 15:32:00.149829 29777 ts_tablet_manager.cc:449] Registered tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:00.150482 29784 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea44e22d92a0ca4491a60972ad44ec5738 I0302 15:32:00.150723 29777 tablet_server_main.cc:41] Starting tablet server... I0302 15:32:00.150799 29785 ts_tablet_manager.cc:314] Bootstrapping tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:00.151396 29784 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea83cdf644557f408f9285368e15c73ba2 I0302 15:32:00.151864 29784 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000008 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008 I0302 15:32:00.151892 29784 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000007 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000007 I0302 15:32:00.151947 29784 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery W0302 15:32:00.152856 29784 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:00.152874 29784 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:00.154899 29785 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap starting. I0302 15:32:00.156759 29785 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea2d7431b6bf064aa2a1d05d2f528ad249 I0302 15:32:00.157083 29785 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000008 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008 I0302 15:32:00.157114 29785 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000007 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000007 I0302 15:32:00.157153 29785 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery W0302 15:32:00.157469 29785 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:00.157487 29785 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:00.158404 29777 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:7050 I0302 15:32:00.158562 29777 webserver.cc:108] Starting webserver on localhost:40132 I0302 15:32:00.158596 29777 webserver.cc:117] Document root disabled I0302 15:32:00.159402 29777 webserver.cc:197] Webserver started. Bound to: http://127.0.0.1:40132/ I0302 15:32:00.159706 29777 server_base.cc:170] Dumped server information to /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/info.pb I0302 15:32:00.159873 29777 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0302 15:32:00.160209 29777 tablet_server_main.cc:44] Tablet server successfully started. I0302 15:32:00.161929 29820 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:50914 I0302 15:32:00.162027 29820 heartbeater.cc:289] Registering TS with master... I0302 15:32:00.162160 29820 heartbeater.cc:295] Sending a full tablet report to master... I0302 15:32:00.162457 28301 ts_manager.cc:71] Re-registered known tablet server { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" instance_seqno: 1425339120158214 } with Master I0302 15:32:00.167884 28280 external_mini_cluster.cc:416] Started /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server as pid 29777 I0302 15:32:00.168133 28280 external_mini_cluster.cc:382] Running /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server kudu-tablet_server --tablet_server_wal_dir=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1 --tablet_server_data_dirs=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1 --tablet_server_rpc_bind_addresses=127.0.0.1:7051 --tablet_server_web_port=55689 --tablet_server_master_addrs=127.0.0.1:50914 --skip_remove_old_recovery_dir --enable_leader_failure_detection=true --tablet_server_rpc_bind_addresses=127.0.0.1:7051 --flush_threshold_mb=1 --log_segment_size_mb=1 --server_dump_info_path=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/info.pb --server_dump_info_format=pb --logtostderr --logbuflevel=-1 --webserver_interface=localhost WARNING: Perftools heap leak checker is active -- Performance may suffer I0302 15:32:00.194726 29825 tablet_server_main.cc:38] Initializing tablet server... I0302 15:32:00.196689 29825 fs_manager.cc:132] Opened local filesystem: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1 uuid: "5748afe5294c41b89cbb67f8edbee2a1" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:32:00.200228 29825 ts_tablet_manager.cc:285] Loading master block 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:00.201390 29825 ts_tablet_manager.cc:449] Registered tablet 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:00.201520 29825 ts_tablet_manager.cc:285] Loading master block ad1251b8988446ffa0348b542d353bd4 I0302 15:32:00.201545 29831 ts_tablet_manager.cc:314] Bootstrapping tablet: 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:00.203733 29831 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap starting. I0302 15:32:00.204406 29825 ts_tablet_manager.cc:449] Registered tablet ad1251b8988446ffa0348b542d353bd4 I0302 15:32:00.204705 29825 ts_tablet_manager.cc:285] Loading master block 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:00.204767 29832 ts_tablet_manager.cc:314] Bootstrapping tablet: ad1251b8988446ffa0348b542d353bd4 I0302 15:32:00.205565 29831 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bead4442d8f88a4c5bb47839c7997b3c95 I0302 15:32:00.206409 29831 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bec75dde950c4547139c428a3c6b050c76 I0302 15:32:00.207485 29831 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bef585995b307447f693b55fc62f93290f I0302 15:32:00.208061 29831 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000008 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008 I0302 15:32:00.208124 29831 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000007 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000007 I0302 15:32:00.208214 29831 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery W0302 15:32:00.208685 29831 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008. Status: Not found: Footer not found. Footer magic doesn't match I0302 15:32:00.208998 29783 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008 for valid entry headers following offset 277615... I0302 15:32:00.208953 29832 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap starting. W0302 15:32:00.209225 29831 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:00.209452 29825 ts_tablet_manager.cc:449] Registered tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:00.209647 29833 ts_tablet_manager.cc:314] Bootstrapping tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:00.209920 29825 tablet_server_main.cc:41] Starting tablet server... I0302 15:32:00.210897 29783 log_util.cc:505] Found no log entry headers I0302 15:32:00.210971 29783 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #752 at offset 277603 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008. Prior batch offsets: 276752 277335 277469 277603: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:00.211077 29783 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008 (valid entries through byte offset 277603) I0302 15:32:00.211161 29832 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be72a54de22165444091e572d1415cbc7c I0302 15:32:00.211755 29832 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000008 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008 I0302 15:32:00.211825 29832 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000007 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000007 I0302 15:32:00.211915 29832 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery W0302 15:32:00.212371 29832 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:00.212415 29832 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:00.213670 29784 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008 for valid entry headers following offset 291329... I0302 15:32:00.215400 29833 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap starting. I0302 15:32:00.215508 29785 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008 for valid entry headers following offset 297254... I0302 15:32:00.215528 29784 log_util.cc:505] Found no log entry headers I0302 15:32:00.215597 29784 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #776 at offset 291317 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008. Prior batch offsets: 290251 290990 291144 291317: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:00.215672 29784 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008 (valid entries through byte offset 291317) I0302 15:32:00.217026 29785 log_util.cc:505] Found no log entry headers I0302 15:32:00.217067 29785 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #806 at offset 297242 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008. Prior batch offsets: 296525 296653 297132 297242: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:00.217134 29785 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008 (valid entries through byte offset 297242) I0302 15:32:00.217285 29825 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:7051 I0302 15:32:00.217495 29825 webserver.cc:108] Starting webserver on localhost:55689 I0302 15:32:00.217536 29825 webserver.cc:117] Document root disabled I0302 15:32:00.217777 29833 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72beb08e33164a81448e9f5ec5c5ca811276 I0302 15:32:00.218111 29833 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000008 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008 I0302 15:32:00.218184 29833 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000007 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000007 I0302 15:32:00.218271 29833 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery I0302 15:32:00.218385 29825 webserver.cc:197] Webserver started. Bound to: http://127.0.0.1:55689/ W0302 15:32:00.218668 29833 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:00.218713 29833 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:00.218861 29825 server_base.cc:170] Dumped server information to /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/info.pb I0302 15:32:00.219081 29825 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0302 15:32:00.219555 29825 tablet_server_main.cc:44] Tablet server successfully started. I0302 15:32:00.221417 29868 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:50914 I0302 15:32:00.221596 29868 heartbeater.cc:289] Registering TS with master... I0302 15:32:00.221798 29868 heartbeater.cc:295] Sending a full tablet report to master... I0302 15:32:00.222141 28294 ts_manager.cc:71] Re-registered known tablet server { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" instance_seqno: 1425339120216913 } with Master I0302 15:32:00.225386 28280 external_mini_cluster.cc:416] Started /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server as pid 29825 I0302 15:32:00.225651 28280 external_mini_cluster.cc:382] Running /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server kudu-tablet_server --tablet_server_wal_dir=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2 --tablet_server_data_dirs=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2 --tablet_server_rpc_bind_addresses=127.0.0.1:7052 --tablet_server_web_port=43948 --tablet_server_master_addrs=127.0.0.1:50914 --skip_remove_old_recovery_dir --enable_leader_failure_detection=true --tablet_server_rpc_bind_addresses=127.0.0.1:7052 --flush_threshold_mb=1 --log_segment_size_mb=1 --server_dump_info_path=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/info.pb --server_dump_info_format=pb --logtostderr --logbuflevel=-1 --webserver_interface=localhost I0302 15:32:00.245163 29785 log.cc:257] Log is configured to *not* fsync() on all Append() calls WARNING: Perftools heap leak checker is active -- Performance may suffer I0302 15:32:00.258906 29871 tablet_server_main.cc:38] Initializing tablet server... I0302 15:32:00.260545 29831 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008 for valid entry headers following offset 277615... I0302 15:32:00.261522 29871 fs_manager.cc:132] Opened local filesystem: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2 uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:32:00.262022 29831 log_util.cc:505] Found no log entry headers I0302 15:32:00.262187 29831 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #752 at offset 277603 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008. Prior batch offsets: 276752 277335 277469 277603: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:00.262277 29831 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008 (valid entries through byte offset 277603) I0302 15:32:00.265462 29871 ts_tablet_manager.cc:285] Loading master block 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:00.267031 29871 ts_tablet_manager.cc:449] Registered tablet 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:00.267169 29871 ts_tablet_manager.cc:285] Loading master block ad1251b8988446ffa0348b542d353bd4 I0302 15:32:00.267192 29883 ts_tablet_manager.cc:314] Bootstrapping tablet: 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:00.270262 29883 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap starting. I0302 15:32:00.271067 29871 ts_tablet_manager.cc:449] Registered tablet ad1251b8988446ffa0348b542d353bd4 I0302 15:32:00.271432 29871 ts_tablet_manager.cc:285] Loading master block 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:00.271783 29884 ts_tablet_manager.cc:314] Bootstrapping tablet: ad1251b8988446ffa0348b542d353bd4 I0302 15:32:00.274731 29884 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap starting. I0302 15:32:00.274911 29871 ts_tablet_manager.cc:449] Registered tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:00.275111 29883 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6d59ab141729e454f835e75a375829585 I0302 15:32:00.276095 29883 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6654790b613054f94b64ae19aec5cde7b I0302 15:32:00.276305 29884 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b627d873184b28487489260eb509383a6d I0302 15:32:00.276695 29884 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000008 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008 I0302 15:32:00.276741 29884 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000007 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000007 I0302 15:32:00.276818 29884 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery I0302 15:32:00.276938 29885 ts_tablet_manager.cc:314] Bootstrapping tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 W0302 15:32:00.277297 29884 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:00.277343 29884 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:00.277624 29883 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b66ffb4ca7d00a46e3a88582582f2b2043 I0302 15:32:00.278257 29883 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000008 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008 I0302 15:32:00.278327 29883 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000007 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000007 I0302 15:32:00.278410 29883 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery W0302 15:32:00.278928 29883 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:00.279031 29883 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:00.280375 29885 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap starting. I0302 15:32:00.282266 29885 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6e1e0289b14fc4d739f6ab75e5a218947 I0302 15:32:00.282744 29832 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008 for valid entry headers following offset 291329... I0302 15:32:00.282788 29885 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000008 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008 I0302 15:32:00.282845 29885 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000007 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000007 I0302 15:32:00.282979 29885 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery W0302 15:32:00.283532 29885 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008. Status: Not found: Footer not found. Footer magic doesn't match I0302 15:32:00.283866 29871 tablet_server_main.cc:41] Starting tablet server... W0302 15:32:00.284028 29885 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:00.284679 29832 log_util.cc:505] Found no log entry headers I0302 15:32:00.284726 29832 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #776 at offset 291317 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008. Prior batch offsets: 290251 290405 291144 291317: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:00.284788 29832 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008 (valid entries through byte offset 291317) I0302 15:32:00.285521 29831 log.cc:257] Log is configured to *not* fsync() on all Append() calls I0302 15:32:00.289422 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/masterz I0302 15:32:00.298825 29833 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008 for valid entry headers following offset 297394... I0302 15:32:00.300783 29833 log_util.cc:505] Found no log entry headers I0302 15:32:00.300839 29833 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #807 at offset 297382 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008. Prior batch offsets: 296665 297144 297272 297382: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:00.300910 29833 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008 (valid entries through byte offset 297382) I0302 15:32:00.314908 29871 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:7052 I0302 15:32:00.315281 29871 webserver.cc:108] Starting webserver on localhost:43948 I0302 15:32:00.315306 29871 webserver.cc:117] Document root disabled I0302 15:32:00.316011 29871 webserver.cc:197] Webserver started. Bound to: http://127.0.0.1:43948/ I0302 15:32:00.316370 29871 server_base.cc:170] Dumped server information to /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/info.pb I0302 15:32:00.317060 29871 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0302 15:32:00.318330 29871 tablet_server_main.cc:44] Tablet server successfully started. I0302 15:32:00.323652 28280 external_mini_cluster.cc:416] Started /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server as pid 29871 I0302 15:32:00.327152 29922 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:50914 I0302 15:32:00.327205 29922 heartbeater.cc:289] Registering TS with master... I0302 15:32:00.327296 29922 heartbeater.cc:295] Sending a full tablet report to master... I0302 15:32:00.327581 28296 ts_manager.cc:71] Re-registered known tablet server { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" instance_seqno: 1425339120314509 } with Master I0302 15:32:00.330476 28280 linked_list-test.cc:164] Verifying rows after restarting entire cluster. I0302 15:32:00.339746 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.349187 29884 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008 for valid entry headers following offset 291457... I0302 15:32:00.350836 29883 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008 for valid entry headers following offset 277615... I0302 15:32:00.352792 29883 log_util.cc:505] Found no log entry headers I0302 15:32:00.352841 29883 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #752 at offset 277603 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008. Prior batch offsets: 276752 276886 277469 277603: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:00.352910 29883 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000008 (valid entries through byte offset 277603) I0302 15:32:00.353165 29884 log_util.cc:505] Found no log entry headers I0302 15:32:00.353236 29884 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #777 at offset 291445 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008. Prior batch offsets: 290379 291118 291272 291445: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:00.353292 29884 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000008 (valid entries through byte offset 291445) I0302 15:32:00.358063 29885 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008 for valid entry headers following offset 296671... I0302 15:32:00.359760 29885 log_util.cc:505] Found no log entry headers I0302 15:32:00.359817 29885 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #805 at offset 296659 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008. Prior batch offsets: 295942 296421 296549 296659: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:00.360117 29885 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000008 (valid entries through byte offset 296659) I0302 15:32:00.366185 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.385277 29883 log.cc:257] Log is configured to *not* fsync() on all Append() calls I0302 15:32:00.387517 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.408906 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.436108 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.457533 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.479333 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.500643 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.522032 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.543346 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.564641 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.585759 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.606974 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.628211 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.649612 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.670882 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.692518 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.713871 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.735374 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.756980 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.778218 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.799494 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.820690 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.841956 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.863263 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.884485 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.905697 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.926954 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.948468 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.969866 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:00.991119 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.012557 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.033862 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.055403 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.076968 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.098273 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.119578 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.140854 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.162114 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.183593 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.204859 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.226218 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.247520 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.268934 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.289607 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/tablez I0302 15:32:01.291348 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.312703 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.333993 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.355309 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.379271 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.400667 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.422067 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.443649 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.455458 29833 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap replayed 1/2 log segments. Stats: ops{read=1415 overwritten=0 applied=1413} inserts{seen=23650 ignored=18394} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 2 replicates I0302 15:32:01.465215 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.486934 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.491387 29785 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap replayed 1/2 log segments. Stats: ops{read=1415 overwritten=0 applied=1414} inserts{seen=23667 ignored=19467} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates I0302 15:32:01.508471 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.515949 29783 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap replayed 1/2 log segments. Stats: ops{read=1415 overwritten=0 applied=1414} inserts{seen=23660 ignored=17706} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 1 replicates I0302 15:32:01.530102 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.551316 29833 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:01.551632 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.558951 29833 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 I0302 15:32:01.573175 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.594594 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.599985 29785 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:01.604243 29785 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 I0302 15:32:01.608297 29783 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:01.611701 29783 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 I0302 15:32:01.616209 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.637681 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.654693 29832 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap replayed 1/2 log segments. Stats: ops{read=1411 overwritten=0 applied=1410} inserts{seen=23695 ignored=19474} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 1 replicates I0302 15:32:01.659279 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.673727 29885 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap replayed 1/2 log segments. Stats: ops{read=1415 overwritten=0 applied=1413} inserts{seen=23651 ignored=18707} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 2 replicates I0302 15:32:01.680835 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.702332 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.723964 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.725811 29884 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap replayed 1/2 log segments. Stats: ops{read=1411 overwritten=0 applied=1409} inserts{seen=23680 ignored=19769} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 2 replicates I0302 15:32:01.737450 29831 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap replayed 1/2 log segments. Stats: ops{read=1415 overwritten=0 applied=1414} inserts{seen=23660 ignored=16560} mutations{seen=0 ignored=0} orphaned_commits=2. Pending: 1 replicates I0302 15:32:01.739179 29832 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:01.745508 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.746088 29832 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 I0302 15:32:01.763517 29883 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap replayed 1/2 log segments. Stats: ops{read=1415 overwritten=0 applied=1414} inserts{seen=23660 ignored=16857} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 1 replicates I0302 15:32:01.767025 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.769464 29885 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:01.776430 29885 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 I0302 15:32:01.781170 29784 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap replayed 1/2 log segments. Stats: ops{read=1411 overwritten=0 applied=1410} inserts{seen=23695 ignored=9574} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 1 replicates I0302 15:32:01.788497 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.810153 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.831707 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.833488 29833 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap replayed 2/2 log segments. Stats: ops{read=1817 overwritten=0 applied=1817} inserts{seen=30380 ignored=18394} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 0 replicates I0302 15:32:01.833560 29833 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10276, Committed OpId: 1.10276, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:01.837729 29884 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:01.843567 29884 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 I0302 15:32:01.844147 29833 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery-1425339121844102 I0302 15:32:01.844197 29833 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery-1425339121844102 I0302 15:32:01.844238 29833 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap complete. I0302 15:32:01.845293 29833 ts_tablet_manager.cc:319] Time spent tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 bootstrap: real 1.636s user 0.863s sys 0.491s I0302 15:32:01.849664 29833 raft_consensus.cc:194] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:01.849733 29833 raft_consensus.cc:211] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:01.849884 29833 raft_consensus.cc:399] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10276 Committed: term: 1 index: 10276} I0302 15:32:01.849949 29833 consensus_queue.cc:127] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10276, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:01.850251 29833 ts_tablet_manager.cc:339] Time spent starting tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: real 0.005s user 0.001s sys 0.004s I0302 15:32:01.851923 29883 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:01.853327 29883 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 I0302 15:32:01.853363 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.853950 29831 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:01.854971 29831 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 I0302 15:32:01.856976 29784 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:01.858453 29784 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 I0302 15:32:01.875056 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.896587 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.917199 29783 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap replayed 2/2 log segments. Stats: ops{read=1790 overwritten=0 applied=1790} inserts{seen=29933 ignored=17706} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 0 replicates I0302 15:32:01.917317 29783 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10274, Committed OpId: 1.10274, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:01.918145 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.919440 29785 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap replayed 2/2 log segments. Stats: ops{read=1817 overwritten=0 applied=1817} inserts{seen=30380 ignored=19467} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0302 15:32:01.919509 29785 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10276, Committed OpId: 1.10276, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:01.928519 29785 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery-1425339121928472 I0302 15:32:01.928568 29785 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery-1425339121928472 I0302 15:32:01.928596 29783 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery-1425339121928558 I0302 15:32:01.930497 29785 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap complete. I0302 15:32:01.930533 29783 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery-1425339121928558 I0302 15:32:01.930627 29783 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap complete. I0302 15:32:01.932131 29785 ts_tablet_manager.cc:319] Time spent tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 bootstrap: real 1.781s user 0.843s sys 0.606s I0302 15:32:01.932610 29783 ts_tablet_manager.cc:319] Time spent tablet 36005aaac18b4c70b2fc03d1382ca7c3 bootstrap: real 1.789s user 0.868s sys 0.610s I0302 15:32:01.938323 29783 raft_consensus.cc:194] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:01.938364 29785 raft_consensus.cc:194] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:01.938386 29783 raft_consensus.cc:211] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:01.938390 29785 raft_consensus.cc:211] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:01.938509 29785 raft_consensus.cc:399] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Becoming Follower/Learner. State: Replica: 892c1da145ed4847b1dfd57983516d8f, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10276 Committed: term: 1 index: 10276} I0302 15:32:01.938534 29783 raft_consensus.cc:399] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Becoming Follower/Learner. State: Replica: 892c1da145ed4847b1dfd57983516d8f, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10274 Committed: term: 1 index: 10274} I0302 15:32:01.938582 29783 consensus_queue.cc:127] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10274, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:01.938583 29785 consensus_queue.cc:127] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10276, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:01.938779 29783 ts_tablet_manager.cc:339] Time spent starting tablet 36005aaac18b4c70b2fc03d1382ca7c3: real 0.006s user 0.003s sys 0.003s I0302 15:32:01.938791 29785 ts_tablet_manager.cc:339] Time spent starting tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: real 0.007s user 0.002s sys 0.004s I0302 15:32:01.939662 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:01.948309 29969 raft_consensus.cc:327] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Failure of peer election-timer detected. Triggering leader election I0302 15:32:01.950952 29969 raft_consensus.cc:1299] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:01.951118 29969 raft_consensus.cc:294] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Starting election with quorum: local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:01.953724 29969 leader_election.cc:187] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 2 election: Requesting vote from peer 3e41e55c8a3a40e3bf81f862aaadfd20 I0302 15:32:01.953817 29969 leader_election.cc:187] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 2 election: Requesting vote from peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:32:01.955652 29856 raft_consensus.cc:1336] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Advancing to term 2 I0302 15:32:01.960073 29856 raft_consensus.cc:1299] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:32:01.961211 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) W0302 15:32:01.961623 29781 leader_election.cc:232] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 3e41e55c8a3a40e3bf81f862aaadfd20: Illegal state: Tablet not RUNNING: BOOTSTRAPPING I0302 15:32:01.964082 29856 raft_consensus.cc:1136] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 892c1da145ed4847b1dfd57983516d8f in term 2. I0302 15:32:01.964275 29781 leader_election.cc:308] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 2 election: Vote granted by peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:32:01.964304 29781 leader_election.cc:281] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0302 15:32:01.964344 29781 raft_consensus.cc:1299] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:01.964375 29781 raft_consensus.cc:1237] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Leader election won for term 2 I0302 15:32:01.964521 29781 raft_consensus.cc:361] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Becoming Leader. State: Replica: 892c1da145ed4847b1dfd57983516d8f, State: 1, Role: LEADER Watermarks: {Received: term: 1 index: 10276 Committed: term: 1 index: 10276} I0302 15:32:01.964563 29781 consensus_queue.cc:119] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 1.10276, Committed index: 1.10276, Last appended: 1.10276, Current term: 2, Majority size: 2, State: 1, Mode: LEADER W0302 15:32:01.965742 29977 raft_consensus_state.cc:477] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 1 index: 10276 New majority replicated is: term: 1 index: 10276. Current term is: 2 I0302 15:32:01.970649 29826 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:32:01.970688 29826 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:32:01.970722 29826 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:32:01.970742 29826 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:32:01.970782 29826 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 30835 or (T in {30835})}] I0302 15:32:01.972306 29826 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:01.972844 29826 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:01.973242 29826 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:01.973589 29826 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:01.982848 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:02.005719 29832 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap replayed 2/2 log segments. Stats: ops{read=1798 overwritten=0 applied=1798} inserts{seen=30318 ignored=19474} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 0 replicates I0302 15:32:02.005756 29832 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10274, Committed OpId: 1.10274, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:02.009099 29832 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery-1425339122009058 I0302 15:32:02.009814 29832 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery-1425339122009058 I0302 15:32:02.009865 29832 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap complete. I0302 15:32:02.012228 29832 ts_tablet_manager.cc:319] Time spent tablet ad1251b8988446ffa0348b542d353bd4 bootstrap: real 1.807s user 0.832s sys 0.521s I0302 15:32:02.014992 29832 raft_consensus.cc:194] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:02.015044 29832 raft_consensus.cc:211] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:02.015117 29832 raft_consensus.cc:399] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10274 Committed: term: 1 index: 10274} I0302 15:32:02.015172 29832 consensus_queue.cc:127] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10274, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:02.015282 29832 ts_tablet_manager.cc:339] Time spent starting tablet ad1251b8988446ffa0348b542d353bd4: real 0.003s user 0.002s sys 0.000s I0302 15:32:02.023865 29826 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bef11abc766bd346bf8310f49ad099ba21 I0302 15:32:02.023967 29826 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:02.024106 29826 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:02.024127 29826 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 30835 or (T in {30835})}] I0302 15:32:02.028902 29826 tablet.cc:1059] Flush successful on 11986 rows (304370 bytes) I0302 15:32:02.029062 29826 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.059s user 0.014s sys 0.009s I0302 15:32:02.041049 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:02.062688 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:02.084487 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:02.099443 29884 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap replayed 2/2 log segments. Stats: ops{read=1798 overwritten=0 applied=1798} inserts{seen=30318 ignored=19769} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 0 replicates I0302 15:32:02.099516 29884 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10274, Committed OpId: 1.10274, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:02.103934 29885 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap replayed 2/2 log segments. Stats: ops{read=1816 overwritten=0 applied=1816} inserts{seen=30364 ignored=18707} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 0 replicates I0302 15:32:02.104002 29885 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10276, Committed OpId: 1.10276, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:02.105988 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:02.107075 29884 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery-1425339122107037 I0302 15:32:02.107115 29884 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery-1425339122107037 I0302 15:32:02.107147 29884 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap complete. I0302 15:32:02.108011 29884 ts_tablet_manager.cc:319] Time spent tablet ad1251b8988446ffa0348b542d353bd4 bootstrap: real 1.836s user 0.999s sys 0.741s I0302 15:32:02.110018 29885 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery-1425339122109968 I0302 15:32:02.110074 29885 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery-1425339122109968 I0302 15:32:02.110134 29885 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap complete. I0302 15:32:02.111246 29831 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap replayed 2/2 log segments. Stats: ops{read=1790 overwritten=0 applied=1790} inserts{seen=29933 ignored=16560} mutations{seen=0 ignored=0} orphaned_commits=2. Pending: 0 replicates I0302 15:32:02.111273 29885 ts_tablet_manager.cc:319] Time spent tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 bootstrap: real 1.834s user 0.962s sys 0.730s I0302 15:32:02.111310 29831 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10274, Committed OpId: 1.10274, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:02.111968 29884 raft_consensus.cc:194] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:02.112040 29884 raft_consensus.cc:211] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:02.112179 29884 raft_consensus.cc:399] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41e55c8a3a40e3bf81f862aaadfd20, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10274 Committed: term: 1 index: 10274} I0302 15:32:02.112259 29884 consensus_queue.cc:127] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10274, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:02.112509 29884 ts_tablet_manager.cc:339] Time spent starting tablet ad1251b8988446ffa0348b542d353bd4: real 0.004s user 0.004s sys 0.000s I0302 15:32:02.113085 29831 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery-1425339122113046 I0302 15:32:02.113128 29831 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery-1425339122113046 I0302 15:32:02.113163 29831 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap complete. I0302 15:32:02.114143 29784 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap replayed 2/2 log segments. Stats: ops{read=1798 overwritten=0 applied=1798} inserts{seen=30318 ignored=9574} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 0 replicates I0302 15:32:02.114158 29831 ts_tablet_manager.cc:319] Time spent tablet 36005aaac18b4c70b2fc03d1382ca7c3 bootstrap: real 1.913s user 0.913s sys 0.506s I0302 15:32:02.114207 29784 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10274, Committed OpId: 1.10274, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:02.114766 29885 raft_consensus.cc:194] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:02.114832 29885 raft_consensus.cc:211] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:02.114918 29885 raft_consensus.cc:399] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41e55c8a3a40e3bf81f862aaadfd20, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10276 Committed: term: 1 index: 10276} I0302 15:32:02.114992 29885 consensus_queue.cc:127] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10276, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:02.115119 29885 ts_tablet_manager.cc:339] Time spent starting tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: real 0.004s user 0.003s sys 0.001s I0302 15:32:02.115331 29831 raft_consensus.cc:194] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:02.115382 29831 raft_consensus.cc:211] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:02.115444 29831 raft_consensus.cc:399] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10274 Committed: term: 1 index: 10274} I0302 15:32:02.115911 29831 consensus_queue.cc:127] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10274, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:02.116044 29831 ts_tablet_manager.cc:339] Time spent starting tablet 36005aaac18b4c70b2fc03d1382ca7c3: real 0.002s user 0.001s sys 0.000s I0302 15:32:02.116255 29784 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery-1425339122116215 I0302 15:32:02.116298 29784 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery-1425339122116215 I0302 15:32:02.116334 29784 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap complete. I0302 15:32:02.117528 29784 ts_tablet_manager.cc:319] Time spent tablet ad1251b8988446ffa0348b542d353bd4 bootstrap: real 1.972s user 0.988s sys 0.619s I0302 15:32:02.119704 29784 raft_consensus.cc:194] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:02.119760 29784 raft_consensus.cc:211] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:02.119839 29784 raft_consensus.cc:399] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Becoming Follower/Learner. State: Replica: 892c1da145ed4847b1dfd57983516d8f, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10274 Committed: term: 1 index: 10274} I0302 15:32:02.119894 29784 consensus_queue.cc:127] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10274, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:02.120023 29784 ts_tablet_manager.cc:339] Time spent starting tablet ad1251b8988446ffa0348b542d353bd4: real 0.002s user 0.001s sys 0.001s I0302 15:32:02.121842 29981 raft_consensus.cc:327] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Failure of peer election-timer detected. Triggering leader election I0302 15:32:02.124193 29981 raft_consensus.cc:1299] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:02.124318 29981 raft_consensus.cc:294] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Starting election with quorum: local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:02.126396 29981 leader_election.cc:187] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 2 election: Requesting vote from peer 892c1da145ed4847b1dfd57983516d8f I0302 15:32:02.126471 29981 leader_election.cc:187] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 2 election: Requesting vote from peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:32:02.127605 29808 raft_consensus.cc:1336] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Advancing to term 2 I0302 15:32:02.130509 29808 raft_consensus.cc:1299] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:32:02.132720 29857 raft_consensus.cc:1336] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Advancing to term 2 I0302 15:32:02.132761 29808 raft_consensus.cc:1136] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41e55c8a3a40e3bf81f862aaadfd20 in term 2. I0302 15:32:02.133186 29881 leader_election.cc:308] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 2 election: Vote granted by peer 892c1da145ed4847b1dfd57983516d8f I0302 15:32:02.133245 29881 leader_election.cc:281] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0302 15:32:02.133318 29881 raft_consensus.cc:1299] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:02.133363 29881 raft_consensus.cc:1237] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Leader election won for term 2 I0302 15:32:02.133543 29881 raft_consensus.cc:361] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: Becoming Leader. State: Replica: 3e41e55c8a3a40e3bf81f862aaadfd20, State: 1, Role: LEADER Watermarks: {Received: term: 1 index: 10274 Committed: term: 1 index: 10274} I0302 15:32:02.133599 29881 consensus_queue.cc:119] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 1.10274, Committed index: 1.10274, Last appended: 1.10274, Current term: 2, Majority size: 2, State: 1, Mode: LEADER I0302 15:32:02.133630 29857 raft_consensus.cc:1299] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:32:02.134575 29857 raft_consensus.cc:1136] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41e55c8a3a40e3bf81f862aaadfd20 in term 2. W0302 15:32:02.134660 29988 raft_consensus_state.cc:477] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 1 index: 10274 New majority replicated is: term: 1 index: 10274. Current term is: 2 I0302 15:32:02.134697 29881 leader_election.cc:308] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 2 election: Vote granted by peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:32:02.152308 29883 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap replayed 2/2 log segments. Stats: ops{read=1790 overwritten=0 applied=1790} inserts{seen=29933 ignored=16857} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 0 replicates I0302 15:32:02.152374 29883 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10274, Committed OpId: 1.10274, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:02.153787 29883 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery-1425339122153752 I0302 15:32:02.153821 29883 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery-1425339122153752 I0302 15:32:02.153848 29883 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap complete. I0302 15:32:02.154670 29883 ts_tablet_manager.cc:319] Time spent tablet 36005aaac18b4c70b2fc03d1382ca7c3 bootstrap: real 1.887s user 1.023s sys 0.754s I0302 15:32:02.156394 29883 raft_consensus.cc:194] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:02.156447 29883 raft_consensus.cc:211] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:02.156517 29883 raft_consensus.cc:399] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41e55c8a3a40e3bf81f862aaadfd20, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10274 Committed: term: 1 index: 10274} I0302 15:32:02.156576 29883 consensus_queue.cc:127] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10274, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:02.156869 29883 ts_tablet_manager.cc:339] Time spent starting tablet 36005aaac18b4c70b2fc03d1382ca7c3: real 0.002s user 0.001s sys 0.000s I0302 15:32:02.162045 29778 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:32:02.162076 29778 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:32:02.162096 29778 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:32:02.162111 29778 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:32:02.162133 29778 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 30900 or (T in {30900})}] I0302 15:32:02.162633 29778 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:02.162945 29778 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:02.163219 29778 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:02.163507 29778 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:02.190914 28280 linked_list-test-util.h:656] Done collecting results (517150 rows in 57.7622ms) I0302 15:32:02.220516 29826 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:32:02.220543 29826 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:32:02.220561 29826 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:32:02.220571 29826 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:32:02.220589 29826 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 31425 or (T in {31425})}] I0302 15:32:02.221238 29826 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:02.222043 29826 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:02.223927 29826 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:02.224227 29968 raft_consensus.cc:327] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Failure of peer election-timer detected. Triggering leader election I0302 15:32:02.226196 29826 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:02.227665 29968 raft_consensus.cc:1299] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:02.227741 29968 raft_consensus.cc:294] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Starting election with quorum: local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:02.235790 29968 leader_election.cc:187] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 2 election: Requesting vote from peer 3e41e55c8a3a40e3bf81f862aaadfd20 I0302 15:32:02.235847 29968 leader_election.cc:187] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 2 election: Requesting vote from peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:32:02.236114 29858 raft_consensus.cc:1336] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Advancing to term 2 I0302 15:32:02.236126 29911 raft_consensus.cc:1336] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Advancing to term 2 I0302 15:32:02.238454 29858 raft_consensus.cc:1299] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:32:02.238457 29911 raft_consensus.cc:1299] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:32:02.240469 29858 raft_consensus.cc:1136] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 892c1da145ed4847b1dfd57983516d8f in term 2. I0302 15:32:02.240489 29911 raft_consensus.cc:1136] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 892c1da145ed4847b1dfd57983516d8f in term 2. I0302 15:32:02.240680 29781 leader_election.cc:308] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 2 election: Vote granted by peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:32:02.240708 29781 leader_election.cc:281] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0302 15:32:02.240743 29781 raft_consensus.cc:1299] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:02.240809 29781 raft_consensus.cc:1237] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Leader election won for term 2 I0302 15:32:02.240967 29781 raft_consensus.cc:361] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Becoming Leader. State: Replica: 892c1da145ed4847b1dfd57983516d8f, State: 1, Role: LEADER Watermarks: {Received: term: 1 index: 10274 Committed: term: 1 index: 10274} I0302 15:32:02.241014 29781 consensus_queue.cc:119] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 1.10274, Committed index: 1.10274, Last appended: 1.10274, Current term: 2, Majority size: 2, State: 1, Mode: LEADER I0302 15:32:02.241762 29781 leader_election.cc:308] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 2 election: Vote granted by peer 3e41e55c8a3a40e3bf81f862aaadfd20 W0302 15:32:02.241937 29999 raft_consensus_state.cc:477] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 1 index: 10274 New majority replicated is: term: 1 index: 10274. Current term is: 2 I0302 15:32:02.252480 29778 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea171b83c561774b4d8978141b2a2c76e8 I0302 15:32:02.252611 29778 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:02.252756 29778 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:02.252779 29778 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 30900 or (T in {30900})}] I0302 15:32:02.257235 29778 tablet.cc:1059] Flush successful on 12227 rows (310154 bytes) I0302 15:32:02.257436 29778 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.096s user 0.017s sys 0.003s I0302 15:32:02.269847 28280 linked_list-test-util.h:585] Successfully verified 517150 rows I0302 15:32:02.273289 28280 linked_list-test.cc:177] Killing TS: 892c1da145ed4847b1dfd57983516d8f, leader of tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 and verifying that we can still read all results I0302 15:32:02.273342 28280 external_mini_cluster.cc:446] Killing /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server with pid 29777 I0302 15:32:02.274961 29826 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be35c6deaff23a4fa1a7f0dd6e1fad61aa I0302 15:32:02.275061 29826 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:02.275192 29826 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:02.275228 29826 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 31425 or (T in {31425})}] I0302 15:32:02.280128 29826 tablet.cc:1059] Flush successful on 13373 rows (337658 bytes) I0302 15:32:02.280257 29826 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.060s user 0.015s sys 0.005s I0302 15:32:02.289753 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/tablet-servers I0302 15:32:02.319138 29878 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:32:02.319171 29878 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:32:02.319185 29878 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:32:02.319195 29878 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:32:02.319222 29878 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 31006 or (T in {31006})}] I0302 15:32:02.319850 29878 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:02.320134 29878 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:02.320411 29878 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:02.320794 29878 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:02.328162 28280 linked_list-test-util.h:656] Done collecting results (517150 rows in 38.8875ms) I0302 15:32:02.382591 29878 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b62d39fc392434431dad71818933282f76 I0302 15:32:02.382813 29878 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:02.383018 29878 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:02.383069 29878 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 31006 or (T in {31006})}] I0302 15:32:02.394246 29878 tablet.cc:1059] Flush successful on 13076 rows (330530 bytes) I0302 15:32:02.394501 29878 maintenance_manager.cc:316] Time spent running FlushMRSOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.076s user 0.016s sys 0.005s I0302 15:32:02.405431 28280 linked_list-test-util.h:585] Successfully verified 517150 rows I0302 15:32:02.406158 28280 external_mini_cluster.cc:446] Killing /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server with pid 29825 I0302 15:32:02.415863 28280 external_mini_cluster.cc:446] Killing /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server with pid 29871 I0302 15:32:02.426208 28280 external_mini_cluster.cc:382] Running /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server kudu-tablet_server --tablet_server_wal_dir=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0 --tablet_server_data_dirs=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0 --tablet_server_rpc_bind_addresses=127.0.0.1:7050 --tablet_server_web_port=40132 --tablet_server_master_addrs=127.0.0.1:50914 --skip_remove_old_recovery_dir --enable_leader_failure_detection=true --tablet_server_rpc_bind_addresses=127.0.0.1:7050 --flush_threshold_mb=1 --log_segment_size_mb=1 --server_dump_info_path=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/info.pb --server_dump_info_format=pb --logtostderr --logbuflevel=-1 --webserver_interface=localhost WARNING: Perftools heap leak checker is active -- Performance may suffer I0302 15:32:02.451899 30003 tablet_server_main.cc:38] Initializing tablet server... I0302 15:32:02.453835 30003 fs_manager.cc:132] Opened local filesystem: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0 uuid: "892c1da145ed4847b1dfd57983516d8f" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:32:02.456545 30003 ts_tablet_manager.cc:285] Loading master block 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.457576 30003 ts_tablet_manager.cc:449] Registered tablet 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.457690 30003 ts_tablet_manager.cc:285] Loading master block ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.457706 30009 ts_tablet_manager.cc:314] Bootstrapping tablet: 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.459980 30003 ts_tablet_manager.cc:449] Registered tablet ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.460070 30009 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap starting. I0302 15:32:02.460258 30003 ts_tablet_manager.cc:285] Loading master block 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.460386 30010 ts_tablet_manager.cc:314] Bootstrapping tablet: ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.461771 30009 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea9bd1cf650f6841ea921cc25b115b7599 I0302 15:32:02.462695 30009 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea171b83c561774b4d8978141b2a2c76e8 I0302 15:32:02.463174 30009 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000001 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000001 I0302 15:32:02.463220 30009 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 I0302 15:32:02.463299 30009 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery I0302 15:32:02.463829 30010 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap starting. W0302 15:32:02.463831 30009 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.463914 30009 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.464699 30003 ts_tablet_manager.cc:449] Registered tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.464885 30011 ts_tablet_manager.cc:314] Bootstrapping tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.465095 30010 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea44e22d92a0ca4491a60972ad44ec5738 I0302 15:32:02.465193 30003 tablet_server_main.cc:41] Starting tablet server... I0302 15:32:02.466171 30010 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea83cdf644557f408f9285368e15c73ba2 I0302 15:32:02.466630 30010 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000001 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000001 I0302 15:32:02.466707 30010 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 I0302 15:32:02.466816 30010 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery W0302 15:32:02.467332 30010 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.467375 30010 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.469563 30011 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap starting. I0302 15:32:02.471297 30011 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea2d7431b6bf064aa2a1d05d2f528ad249 I0302 15:32:02.471704 30011 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000001 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000001 I0302 15:32:02.471792 30011 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 I0302 15:32:02.471824 30003 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:7050 I0302 15:32:02.471865 30011 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery I0302 15:32:02.472033 30003 webserver.cc:108] Starting webserver on localhost:40132 I0302 15:32:02.472064 30003 webserver.cc:117] Document root disabled W0302 15:32:02.472575 30011 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.472591 30011 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.472977 30003 webserver.cc:197] Webserver started. Bound to: http://127.0.0.1:40132/ I0302 15:32:02.473290 30003 server_base.cc:170] Dumped server information to /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/info.pb I0302 15:32:02.473938 30003 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0302 15:32:02.474104 30003 tablet_server_main.cc:44] Tablet server successfully started. I0302 15:32:02.475877 30046 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:50914 I0302 15:32:02.475975 30046 heartbeater.cc:289] Registering TS with master... I0302 15:32:02.476047 30046 heartbeater.cc:295] Sending a full tablet report to master... I0302 15:32:02.476336 28297 ts_manager.cc:71] Re-registered known tablet server { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" instance_seqno: 1425339122471420 } with Master I0302 15:32:02.482980 28280 external_mini_cluster.cc:416] Started /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server as pid 30003 I0302 15:32:02.483319 28280 external_mini_cluster.cc:382] Running /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server kudu-tablet_server --tablet_server_wal_dir=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1 --tablet_server_data_dirs=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1 --tablet_server_rpc_bind_addresses=127.0.0.1:7051 --tablet_server_web_port=55689 --tablet_server_master_addrs=127.0.0.1:50914 --skip_remove_old_recovery_dir --enable_leader_failure_detection=true --tablet_server_rpc_bind_addresses=127.0.0.1:7051 --flush_threshold_mb=1 --log_segment_size_mb=1 --server_dump_info_path=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/info.pb --server_dump_info_format=pb --logtostderr --logbuflevel=-1 --webserver_interface=localhost WARNING: Perftools heap leak checker is active -- Performance may suffer I0302 15:32:02.514143 30050 tablet_server_main.cc:38] Initializing tablet server... I0302 15:32:02.517494 30050 fs_manager.cc:132] Opened local filesystem: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1 uuid: "5748afe5294c41b89cbb67f8edbee2a1" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:32:02.519568 30009 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 for valid entry headers following offset 240073... I0302 15:32:02.521662 30009 log_util.cc:505] Found no log entry headers I0302 15:32:02.521706 30050 ts_tablet_manager.cc:285] Loading master block 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.521754 30009 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #653 at offset 240061 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002. Prior batch offsets: 239391 239525 239659 240061: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.521839 30009 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 (valid entries through byte offset 240061) I0302 15:32:02.523314 30050 ts_tablet_manager.cc:449] Registered tablet 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.523463 30050 ts_tablet_manager.cc:285] Loading master block ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.523490 30067 ts_tablet_manager.cc:314] Bootstrapping tablet: 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.525470 30011 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 for valid entry headers following offset 255151... I0302 15:32:02.526867 30067 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap starting. I0302 15:32:02.527020 30010 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 for valid entry headers following offset 271817... I0302 15:32:02.527441 30050 ts_tablet_manager.cc:449] Registered tablet ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.527637 30050 ts_tablet_manager.cc:285] Loading master block 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.527675 30011 log_util.cc:505] Found no log entry headers I0302 15:32:02.527690 30068 ts_tablet_manager.cc:314] Bootstrapping tablet: ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.527740 30011 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #691 at offset 255139 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002. Prior batch offsets: 254148 254627 254737 255139: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.527825 30011 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 (valid entries through byte offset 255139) I0302 15:32:02.528923 30067 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bead4442d8f88a4c5bb47839c7997b3c95 I0302 15:32:02.529034 30010 log_util.cc:505] Found no log entry headers I0302 15:32:02.529099 30010 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #725 at offset 271805 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002. Prior batch offsets: 270739 271478 271632 271805: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.529182 30010 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 (valid entries through byte offset 271805) I0302 15:32:02.529906 30067 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bec75dde950c4547139c428a3c6b050c76 I0302 15:32:02.531028 30067 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bef585995b307447f693b55fc62f93290f I0302 15:32:02.531842 30050 ts_tablet_manager.cc:449] Registered tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.531849 30067 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be35c6deaff23a4fa1a7f0dd6e1fad61aa I0302 15:32:02.532199 30068 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap starting. I0302 15:32:02.532359 30067 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000001 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000001 I0302 15:32:02.532361 30069 ts_tablet_manager.cc:314] Bootstrapping tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.532392 30067 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 I0302 15:32:02.532477 30050 tablet_server_main.cc:41] Starting tablet server... I0302 15:32:02.532490 30067 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery W0302 15:32:02.533689 30067 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.533880 30067 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.534698 30069 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap starting. I0302 15:32:02.535338 30068 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be72a54de22165444091e572d1415cbc7c I0302 15:32:02.535825 30068 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000001 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000001 I0302 15:32:02.536566 30068 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 I0302 15:32:02.536286 30069 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72beb08e33164a81448e9f5ec5c5ca811276 I0302 15:32:02.536742 30068 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery W0302 15:32:02.537521 30068 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.537572 30068 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.537523 30069 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bef11abc766bd346bf8310f49ad099ba21 I0302 15:32:02.537971 30069 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000001 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000001 I0302 15:32:02.538014 30069 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 I0302 15:32:02.538089 30069 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery W0302 15:32:02.538507 30069 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.538549 30069 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.547498 30009 log.cc:257] Log is configured to *not* fsync() on all Append() calls I0302 15:32:02.576568 30050 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:7051 I0302 15:32:02.576771 30050 webserver.cc:108] Starting webserver on localhost:55689 I0302 15:32:02.576792 30050 webserver.cc:117] Document root disabled I0302 15:32:02.577628 30050 webserver.cc:197] Webserver started. Bound to: http://127.0.0.1:55689/ I0302 15:32:02.577987 30050 server_base.cc:170] Dumped server information to /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/info.pb I0302 15:32:02.578212 30050 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0302 15:32:02.578541 30050 tablet_server_main.cc:44] Tablet server successfully started. I0302 15:32:02.580817 30110 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:50914 I0302 15:32:02.580901 30110 heartbeater.cc:289] Registering TS with master... I0302 15:32:02.581075 30110 heartbeater.cc:295] Sending a full tablet report to master... I0302 15:32:02.581404 28299 ts_manager.cc:71] Re-registered known tablet server { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" instance_seqno: 1425339122576124 } with Master I0302 15:32:02.583173 28280 external_mini_cluster.cc:416] Started /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server as pid 30050 I0302 15:32:02.583513 28280 external_mini_cluster.cc:382] Running /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server kudu-tablet_server --tablet_server_wal_dir=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2 --tablet_server_data_dirs=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2 --tablet_server_rpc_bind_addresses=127.0.0.1:7052 --tablet_server_web_port=43948 --tablet_server_master_addrs=127.0.0.1:50914 --skip_remove_old_recovery_dir --enable_leader_failure_detection=true --tablet_server_rpc_bind_addresses=127.0.0.1:7052 --flush_threshold_mb=1 --log_segment_size_mb=1 --server_dump_info_path=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/info.pb --server_dump_info_format=pb --logtostderr --logbuflevel=-1 --webserver_interface=localhost I0302 15:32:02.583755 30067 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 for valid entry headers following offset 243447... I0302 15:32:02.586135 30067 log_util.cc:505] Found no log entry headers I0302 15:32:02.586161 30067 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #663 at offset 243435 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002. Prior batch offsets: 242584 243167 243301 243435: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.586221 30067 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 (valid entries through byte offset 243435) I0302 15:32:02.606848 30069 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 for valid entry headers following offset 258139... I0302 15:32:02.607594 30068 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 for valid entry headers following offset 250016... I0302 15:32:02.609149 30067 log.cc:257] Log is configured to *not* fsync() on all Append() calls I0302 15:32:02.609465 30069 log_util.cc:505] Found no log entry headers I0302 15:32:02.609514 30069 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #699 at offset 258127 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002. Prior batch offsets: 257410 257889 258017 258127: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.609578 30069 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 (valid entries through byte offset 258127) I0302 15:32:02.616812 30068 log_util.cc:505] Found no log entry headers I0302 15:32:02.616850 30068 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #666 at offset 250004 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002. Prior batch offsets: 248938 249092 249831 250004: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.616905 30068 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 (valid entries through byte offset 250004) WARNING: Perftools heap leak checker is active -- Performance may suffer I0302 15:32:02.625717 30113 tablet_server_main.cc:38] Initializing tablet server... I0302 15:32:02.628510 30113 fs_manager.cc:132] Opened local filesystem: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2 uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:32:02.633131 30113 ts_tablet_manager.cc:285] Loading master block 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.634858 30113 ts_tablet_manager.cc:449] Registered tablet 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.634997 30113 ts_tablet_manager.cc:285] Loading master block ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.635025 30123 ts_tablet_manager.cc:314] Bootstrapping tablet: 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.638293 30113 ts_tablet_manager.cc:449] Registered tablet ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.638604 30113 ts_tablet_manager.cc:285] Loading master block 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.638651 30126 ts_tablet_manager.cc:314] Bootstrapping tablet: ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.640979 30113 ts_tablet_manager.cc:449] Registered tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.641412 30123 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap starting. I0302 15:32:02.641612 30127 ts_tablet_manager.cc:314] Bootstrapping tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.643595 30126 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap starting. I0302 15:32:02.645424 30123 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6d59ab141729e454f835e75a375829585 I0302 15:32:02.645649 30126 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b627d873184b28487489260eb509383a6d I0302 15:32:02.646338 30126 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000001 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000001 I0302 15:32:02.646394 30126 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 I0302 15:32:02.646497 30126 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery I0302 15:32:02.646508 30123 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6654790b613054f94b64ae19aec5cde7b I0302 15:32:02.647085 30127 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap starting. W0302 15:32:02.647526 30126 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.647950 30126 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.648996 30123 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b66ffb4ca7d00a46e3a88582582f2b2043 I0302 15:32:02.649699 30123 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b62d39fc392434431dad71818933282f76 I0302 15:32:02.650362 30123 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000001 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000001 I0302 15:32:02.650431 30123 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 I0302 15:32:02.651196 30123 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery I0302 15:32:02.651432 30127 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6e1e0289b14fc4d739f6ab75e5a218947 W0302 15:32:02.651672 30123 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.651692 30123 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.651734 30127 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000001 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000001 I0302 15:32:02.651801 30127 tablet_bootstrap.cc:509] Will attempt to recover log segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 I0302 15:32:02.651888 30127 tablet_bootstrap.cc:519] Moved log directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7 to recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery W0302 15:32:02.652384 30127 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.652426 30127 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.653133 30113 tablet_server_main.cc:41] Starting tablet server... I0302 15:32:02.667810 30113 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:7052 I0302 15:32:02.668089 30113 webserver.cc:108] Starting webserver on localhost:43948 I0302 15:32:02.668109 30113 webserver.cc:117] Document root disabled I0302 15:32:02.669265 30113 webserver.cc:197] Webserver started. Bound to: http://127.0.0.1:43948/ I0302 15:32:02.670063 30113 server_base.cc:170] Dumped server information to /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/info.pb I0302 15:32:02.670959 30113 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0302 15:32:02.671286 30113 tablet_server_main.cc:44] Tablet server successfully started. I0302 15:32:02.672965 28280 external_mini_cluster.cc:416] Started /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server as pid 30113 I0302 15:32:02.678566 30162 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:50914 I0302 15:32:02.678632 30162 heartbeater.cc:289] Registering TS with master... I0302 15:32:02.678699 30162 heartbeater.cc:295] Sending a full tablet report to master... I0302 15:32:02.679632 28296 ts_manager.cc:71] Re-registered known tablet server { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" instance_seqno: 1425339122667406 } with Master I0302 15:32:02.714407 30123 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 for valid entry headers following offset 243307... I0302 15:32:02.716333 30123 log_util.cc:505] Found no log entry headers I0302 15:32:02.716403 30123 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #662 at offset 243295 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002. Prior batch offsets: 242444 242578 243161 243295: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.716909 30123 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 (valid entries through byte offset 243295) I0302 15:32:02.720614 30127 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 for valid entry headers following offset 254065... I0302 15:32:02.722602 30127 log_util.cc:505] Found no log entry headers I0302 15:32:02.722667 30127 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #688 at offset 254053 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002. Prior batch offsets: 253336 253815 253943 254053: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.722750 30127 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 (valid entries through byte offset 254053) I0302 15:32:02.728458 30126 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 for valid entry headers following offset 248090... I0302 15:32:02.729872 30126 log_util.cc:505] Found no log entry headers I0302 15:32:02.729902 30126 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #659 at offset 248078 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002. Prior batch offsets: 247349 247503 247676 248078: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.729936 30126 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 (valid entries through byte offset 248078) I0302 15:32:02.741082 30123 log.cc:257] Log is configured to *not* fsync() on all Append() calls I0302 15:32:02.783108 28280 external_mini_cluster.cc:446] Killing /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server with pid 30003 I0302 15:32:02.790982 28280 external_mini_cluster.cc:446] Killing /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server with pid 30050 I0302 15:32:02.800652 28280 external_mini_cluster.cc:446] Killing /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server with pid 30113 I0302 15:32:02.805047 28280 external_mini_cluster.cc:382] Running /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server kudu-tablet_server --tablet_server_wal_dir=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0 --tablet_server_data_dirs=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0 --tablet_server_rpc_bind_addresses=127.0.0.1:7050 --tablet_server_web_port=40132 --tablet_server_master_addrs=127.0.0.1:50914 --skip_remove_old_recovery_dir --enable_leader_failure_detection=true --tablet_server_rpc_bind_addresses=127.0.0.1:7050 --flush_threshold_mb=1 --log_segment_size_mb=1 --server_dump_info_path=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/info.pb --server_dump_info_format=pb --logtostderr --logbuflevel=-1 --webserver_interface=localhost WARNING: Perftools heap leak checker is active -- Performance may suffer I0302 15:32:02.830706 30179 tablet_server_main.cc:38] Initializing tablet server... I0302 15:32:02.832682 30179 fs_manager.cc:132] Opened local filesystem: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0 uuid: "892c1da145ed4847b1dfd57983516d8f" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:32:02.835528 30179 ts_tablet_manager.cc:285] Loading master block 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.836572 30179 ts_tablet_manager.cc:449] Registered tablet 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.836684 30179 ts_tablet_manager.cc:285] Loading master block ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.836704 30185 ts_tablet_manager.cc:314] Bootstrapping tablet: 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.839256 30179 ts_tablet_manager.cc:449] Registered tablet ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.839277 30185 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap starting. I0302 15:32:02.839491 30179 ts_tablet_manager.cc:285] Loading master block 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.839509 30186 ts_tablet_manager.cc:314] Bootstrapping tablet: ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.840891 30185 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea9bd1cf650f6841ea921cc25b115b7599 I0302 15:32:02.841759 30185 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea171b83c561774b4d8978141b2a2c76e8 I0302 15:32:02.842140 30185 tablet_bootstrap.cc:471] Replaying from previous recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery I0302 15:32:02.842257 30185 tablet_bootstrap.cc:481] Removing old log file from previous aborted recovery attempt: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000001 W0302 15:32:02.842789 30185 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.842823 30185 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.843062 30186 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap starting. I0302 15:32:02.843937 30179 ts_tablet_manager.cc:449] Registered tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.844269 30187 ts_tablet_manager.cc:314] Bootstrapping tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.844317 30186 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea44e22d92a0ca4491a60972ad44ec5738 I0302 15:32:02.844550 30179 tablet_server_main.cc:41] Starting tablet server... I0302 15:32:02.845360 30186 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea83cdf644557f408f9285368e15c73ba2 I0302 15:32:02.845799 30186 tablet_bootstrap.cc:471] Replaying from previous recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery I0302 15:32:02.846089 30186 tablet_bootstrap.cc:481] Removing old log file from previous aborted recovery attempt: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000001 W0302 15:32:02.846773 30186 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.846796 30186 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.848305 30187 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap starting. I0302 15:32:02.850327 30187 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea2d7431b6bf064aa2a1d05d2f528ad249 I0302 15:32:02.850644 30187 tablet_bootstrap.cc:471] Replaying from previous recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery I0302 15:32:02.850745 30187 tablet_bootstrap.cc:481] Removing old log file from previous aborted recovery attempt: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000001 I0302 15:32:02.851235 30179 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:7050 W0302 15:32:02.851351 30187 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.851734 30187 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.852020 30179 webserver.cc:108] Starting webserver on localhost:40132 I0302 15:32:02.852061 30179 webserver.cc:117] Document root disabled I0302 15:32:02.852970 30179 webserver.cc:197] Webserver started. Bound to: http://127.0.0.1:40132/ I0302 15:32:02.853350 30179 server_base.cc:170] Dumped server information to /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/info.pb I0302 15:32:02.853710 30179 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0302 15:32:02.853883 30179 tablet_server_main.cc:44] Tablet server successfully started. I0302 15:32:02.855911 30222 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:50914 I0302 15:32:02.856086 30222 heartbeater.cc:289] Registering TS with master... I0302 15:32:02.856186 30222 heartbeater.cc:295] Sending a full tablet report to master... I0302 15:32:02.856506 28293 ts_manager.cc:71] Re-registered known tablet server { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" instance_seqno: 1425339122851025 } with Master I0302 15:32:02.861335 28280 external_mini_cluster.cc:416] Started /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server as pid 30179 I0302 15:32:02.861651 28280 external_mini_cluster.cc:382] Running /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server kudu-tablet_server --tablet_server_wal_dir=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1 --tablet_server_data_dirs=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1 --tablet_server_rpc_bind_addresses=127.0.0.1:7051 --tablet_server_web_port=55689 --tablet_server_master_addrs=127.0.0.1:50914 --skip_remove_old_recovery_dir --enable_leader_failure_detection=true --tablet_server_rpc_bind_addresses=127.0.0.1:7051 --flush_threshold_mb=1 --log_segment_size_mb=1 --server_dump_info_path=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/info.pb --server_dump_info_format=pb --logtostderr --logbuflevel=-1 --webserver_interface=localhost WARNING: Perftools heap leak checker is active -- Performance may suffer I0302 15:32:02.889874 30225 tablet_server_main.cc:38] Initializing tablet server... I0302 15:32:02.891872 30225 fs_manager.cc:132] Opened local filesystem: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1 uuid: "5748afe5294c41b89cbb67f8edbee2a1" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:32:02.893271 30185 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 for valid entry headers following offset 240073... I0302 15:32:02.894515 30185 log_util.cc:505] Found no log entry headers I0302 15:32:02.894569 30185 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #653 at offset 240061 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002. Prior batch offsets: 239391 239525 239659 240061: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.894636 30185 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 (valid entries through byte offset 240061) I0302 15:32:02.894754 30225 ts_tablet_manager.cc:285] Loading master block 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.895894 30225 ts_tablet_manager.cc:449] Registered tablet 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.896016 30225 ts_tablet_manager.cc:285] Loading master block ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.896036 30231 ts_tablet_manager.cc:314] Bootstrapping tablet: 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.898391 30231 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap starting. I0302 15:32:02.898931 30225 ts_tablet_manager.cc:449] Registered tablet ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.899325 30225 ts_tablet_manager.cc:285] Loading master block 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.899358 30232 ts_tablet_manager.cc:314] Bootstrapping tablet: ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.900254 30231 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bead4442d8f88a4c5bb47839c7997b3c95 I0302 15:32:02.901044 30231 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bec75dde950c4547139c428a3c6b050c76 I0302 15:32:02.901857 30231 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bef585995b307447f693b55fc62f93290f I0302 15:32:02.902779 30231 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be35c6deaff23a4fa1a7f0dd6e1fad61aa I0302 15:32:02.903036 30187 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 for valid entry headers following offset 255151... I0302 15:32:02.903156 30231 tablet_bootstrap.cc:471] Replaying from previous recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery I0302 15:32:02.903291 30231 tablet_bootstrap.cc:481] Removing old log file from previous aborted recovery attempt: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000001 I0302 15:32:02.903628 30225 ts_tablet_manager.cc:449] Registered tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.903666 30232 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap starting. I0302 15:32:02.903885 30233 ts_tablet_manager.cc:314] Bootstrapping tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 W0302 15:32:02.903885 30231 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.904104 30231 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.904196 30187 log_util.cc:505] Found no log entry headers I0302 15:32:02.904242 30187 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #691 at offset 255139 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002. Prior batch offsets: 254148 254627 254737 255139: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.904289 30187 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 (valid entries through byte offset 255139) I0302 15:32:02.905086 30186 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 for valid entry headers following offset 271817... I0302 15:32:02.905138 30225 tablet_server_main.cc:41] Starting tablet server... I0302 15:32:02.905377 30232 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be72a54de22165444091e572d1415cbc7c I0302 15:32:02.905772 30232 tablet_bootstrap.cc:471] Replaying from previous recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery I0302 15:32:02.905930 30232 tablet_bootstrap.cc:481] Removing old log file from previous aborted recovery attempt: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000001 W0302 15:32:02.906569 30232 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match I0302 15:32:02.906580 30186 log_util.cc:505] Found no log entry headers I0302 15:32:02.906615 30186 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #725 at offset 271805 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002. Prior batch offsets: 270739 271478 271632 271805: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.906673 30186 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 (valid entries through byte offset 271805) W0302 15:32:02.907943 30232 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.910890 30233 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap starting. I0302 15:32:02.913231 30233 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72beb08e33164a81448e9f5ec5c5ca811276 I0302 15:32:02.914480 30233 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72bef11abc766bd346bf8310f49ad099ba21 I0302 15:32:02.914968 30233 tablet_bootstrap.cc:471] Replaying from previous recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery I0302 15:32:02.915094 30233 tablet_bootstrap.cc:481] Removing old log file from previous aborted recovery attempt: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000001 W0302 15:32:02.915844 30233 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.915887 30233 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.916458 30225 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:7051 I0302 15:32:02.916668 30225 webserver.cc:108] Starting webserver on localhost:55689 I0302 15:32:02.916692 30225 webserver.cc:117] Document root disabled I0302 15:32:02.917562 30225 webserver.cc:197] Webserver started. Bound to: http://127.0.0.1:55689/ I0302 15:32:02.918001 30225 server_base.cc:170] Dumped server information to /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/info.pb I0302 15:32:02.918215 30225 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0302 15:32:02.918544 30225 tablet_server_main.cc:44] Tablet server successfully started. I0302 15:32:02.919684 28280 external_mini_cluster.cc:416] Started /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server as pid 30225 I0302 15:32:02.919940 28280 external_mini_cluster.cc:382] Running /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server kudu-tablet_server --tablet_server_wal_dir=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2 --tablet_server_data_dirs=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2 --tablet_server_rpc_bind_addresses=127.0.0.1:7052 --tablet_server_web_port=43948 --tablet_server_master_addrs=127.0.0.1:50914 --skip_remove_old_recovery_dir --enable_leader_failure_detection=true --tablet_server_rpc_bind_addresses=127.0.0.1:7052 --flush_threshold_mb=1 --log_segment_size_mb=1 --server_dump_info_path=/data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/info.pb --server_dump_info_format=pb --logtostderr --logbuflevel=-1 --webserver_interface=localhost I0302 15:32:02.920884 30187 log.cc:257] Log is configured to *not* fsync() on all Append() calls I0302 15:32:02.922811 30268 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:50914 I0302 15:32:02.922907 30268 heartbeater.cc:289] Registering TS with master... I0302 15:32:02.923082 30268 heartbeater.cc:295] Sending a full tablet report to master... I0302 15:32:02.923512 28301 ts_manager.cc:71] Re-registered known tablet server { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" instance_seqno: 1425339122915906 } with Master WARNING: Perftools heap leak checker is active -- Performance may suffer I0302 15:32:02.956804 30275 tablet_server_main.cc:38] Initializing tablet server... I0302 15:32:02.958395 30231 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 for valid entry headers following offset 243447... I0302 15:32:02.959455 30275 fs_manager.cc:132] Opened local filesystem: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2 uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" format_stamp: "Formatted at 2015-03-02 23:31:27 on boost-static-burst-slave-cc0.vpc.cloudera.com" I0302 15:32:02.960043 30231 log_util.cc:505] Found no log entry headers I0302 15:32:02.960105 30231 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #663 at offset 243435 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002. Prior batch offsets: 242584 243167 243301 243435: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.960177 30231 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 (valid entries through byte offset 243435) I0302 15:32:02.963503 30275 ts_tablet_manager.cc:285] Loading master block 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.965270 30275 ts_tablet_manager.cc:449] Registered tablet 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.965400 30275 ts_tablet_manager.cc:285] Loading master block ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.965421 30283 ts_tablet_manager.cc:314] Bootstrapping tablet: 36005aaac18b4c70b2fc03d1382ca7c3 I0302 15:32:02.968845 30283 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap starting. I0302 15:32:02.969300 30275 ts_tablet_manager.cc:449] Registered tablet ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.969655 30275 ts_tablet_manager.cc:285] Loading master block 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.969940 30232 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 for valid entry headers following offset 250016... I0302 15:32:02.970234 30284 ts_tablet_manager.cc:314] Bootstrapping tablet: ad1251b8988446ffa0348b542d353bd4 I0302 15:32:02.970855 30233 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 for valid entry headers following offset 258139... I0302 15:32:02.971544 30232 log_util.cc:505] Found no log entry headers I0302 15:32:02.971595 30232 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #666 at offset 250004 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002. Prior batch offsets: 248938 249092 249831 250004: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.971673 30232 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 (valid entries through byte offset 250004) I0302 15:32:02.972503 30233 log_util.cc:505] Found no log entry headers I0302 15:32:02.972551 30233 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #699 at offset 258127 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002. Prior batch offsets: 257410 257889 258017 258127: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:02.972621 30233 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 (valid entries through byte offset 258127) I0302 15:32:02.973067 30275 ts_tablet_manager.cc:449] Registered tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.973093 30284 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap starting. I0302 15:32:02.973222 30283 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6d59ab141729e454f835e75a375829585 I0302 15:32:02.974197 30283 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6654790b613054f94b64ae19aec5cde7b I0302 15:32:02.974452 30284 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b627d873184b28487489260eb509383a6d I0302 15:32:02.974740 30284 tablet_bootstrap.cc:471] Replaying from previous recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery I0302 15:32:02.974859 30284 tablet_bootstrap.cc:481] Removing old log file from previous aborted recovery attempt: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000001 I0302 15:32:02.974910 30283 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b66ffb4ca7d00a46e3a88582582f2b2043 W0302 15:32:02.975347 30284 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.975389 30284 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.975654 30283 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b62d39fc392434431dad71818933282f76 I0302 15:32:02.975894 30283 tablet_bootstrap.cc:471] Replaying from previous recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery I0302 15:32:02.976002 30283 tablet_bootstrap.cc:481] Removing old log file from previous aborted recovery attempt: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000001 W0302 15:32:02.976495 30283 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.976557 30283 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.980587 30285 ts_tablet_manager.cc:314] Bootstrapping tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 I0302 15:32:02.980978 30231 log.cc:257] Log is configured to *not* fsync() on all Append() calls I0302 15:32:02.981784 30275 tablet_server_main.cc:41] Starting tablet server... I0302 15:32:02.987658 30285 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap starting. I0302 15:32:02.992689 30285 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6e1e0289b14fc4d739f6ab75e5a218947 I0302 15:32:02.993111 30285 tablet_bootstrap.cc:471] Replaying from previous recovery directory: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery I0302 15:32:02.993237 30285 tablet_bootstrap.cc:481] Removing old log file from previous aborted recovery attempt: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000001 W0302 15:32:02.993940 30285 log_util.cc:147] Could not read footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002. Status: Not found: Footer not found. Footer magic doesn't match W0302 15:32:02.994007 30285 log_reader.cc:136] Segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 was likely left in-progress after a previous crash. Will try to rebuild footer by scanning data I0302 15:32:02.995748 30275 rpc_server.cc:110] RPC server started. Bound to: 127.0.0.1:7052 I0302 15:32:02.996014 30275 webserver.cc:108] Starting webserver on localhost:43948 I0302 15:32:02.996047 30275 webserver.cc:117] Document root disabled I0302 15:32:02.996961 30275 webserver.cc:197] Webserver started. Bound to: http://127.0.0.1:43948/ I0302 15:32:02.997385 30275 server_base.cc:170] Dumped server information to /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/info.pb I0302 15:32:02.999397 28280 external_mini_cluster.cc:416] Started /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server as pid 30275 I0302 15:32:03.002908 30275 maintenance_manager.cc:111] MaintenanceManager: targeting memory size of 23.515860 GB I0302 15:32:03.005635 30275 tablet_server_main.cc:44] Tablet server successfully started. I0302 15:32:03.008328 30322 heartbeater.cc:219] Connected to a leader master server at 127.0.0.1:50914 I0302 15:32:03.008388 30322 heartbeater.cc:289] Registering TS with master... I0302 15:32:03.008469 30322 heartbeater.cc:295] Sending a full tablet report to master... I0302 15:32:03.008783 28292 ts_manager.cc:71] Re-registered known tablet server { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" instance_seqno: 1425339122995351 } with Master I0302 15:32:03.013067 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.013903 30283 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 for valid entry headers following offset 243307... I0302 15:32:03.015329 30283 log_util.cc:505] Found no log entry headers I0302 15:32:03.015375 30283 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #662 at offset 243295 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002. Prior batch offsets: 242444 242578 243161 243295: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:03.015429 30283 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery/wal-000000002 (valid entries through byte offset 243295) I0302 15:32:03.025070 30283 log.cc:257] Log is configured to *not* fsync() on all Append() calls I0302 15:32:03.042831 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.044306 30284 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 for valid entry headers following offset 248090... I0302 15:32:03.045994 30284 log_util.cc:505] Found no log entry headers I0302 15:32:03.046020 30284 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #659 at offset 248078 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002. Prior batch offsets: 247349 247503 247676 248078: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:03.046072 30284 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery/wal-000000002 (valid entries through byte offset 248078) I0302 15:32:03.048485 30285 log_util.cc:468] Scanning /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 for valid entry headers following offset 254065... I0302 15:32:03.049610 30285 log_util.cc:505] Found no log entry headers I0302 15:32:03.049649 30285 log_util.cc:437] Ignoring corruption Corruption: CRC mismatch in log header: Log file corrupted. Failed trying to read batch #688 at offset 254053 for segment at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002. Prior batch offsets: 253336 253815 253943 254053: there were no further log entries following this one, so likely the log was truncated during writing I0302 15:32:03.049701 30285 log_util.cc:197] Successfully rebuilt footer for segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery/wal-000000002 (valid entries through byte offset 254053) I0302 15:32:03.064538 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.090610 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.112463 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.134181 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.156323 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.178042 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.199503 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.226425 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.247987 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.269213 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.289934 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:40132/jsonmetricz I0302 15:32:03.290779 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.312388 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.338079 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.359648 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.381067 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.402365 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.424914 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.446151 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.467509 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.488821 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.510169 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.531410 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.552618 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.574694 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.595751 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.616974 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.638227 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.659550 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.680850 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.702210 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.723408 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.745872 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.767141 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.788424 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.809757 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.831078 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.852412 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.854969 30185 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap replayed 1/2 log segments. Stats: ops{read=1465 overwritten=0 applied=1464} inserts{seen=24527 ignored=24527} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates I0302 15:32:03.873540 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.894969 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.900707 30185 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:03.903360 30185 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 I0302 15:32:03.916270 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.937582 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.958748 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:03.980146 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.001708 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.011270 30283 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap replayed 1/2 log segments. Stats: ops{read=1460 overwritten=0 applied=1459} inserts{seen=24435 ignored=24435} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates I0302 15:32:04.023425 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.044942 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.061214 30283 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:04.064527 30283 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 I0302 15:32:04.066463 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.088009 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.094936 30185 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap replayed 2/2 log segments. Stats: ops{read=1791 overwritten=0 applied=1790} inserts{seen=29933 ignored=29933} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates I0302 15:32:04.097697 30233 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap replayed 1/2 log segments. Stats: ops{read=1469 overwritten=0 applied=1467} inserts{seen=24530 ignored=24530} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates I0302 15:32:04.103816 30185 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 2.10275, Committed OpId: 1.10274, Pending Replicates: 1, Pending Commits: 0 I0302 15:32:04.103868 30185 tablet_bootstrap.cc:894] Dumping REPLICATES: I0302 15:32:04.103901 30185 tablet_bootstrap.cc:894] type: REPLICATE replicate { id { term: 2 index: 10275 } op_type: CHANGE_CONFIG_OP change_config_request { tablet_id: "36005aaac18b4c70b2fc03d1382ca7c3" old_config { opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } } new_config { local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } } } } I0302 15:32:04.103960 30284 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:04.106729 30284 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 I0302 15:32:04.107409 30185 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery-1425339124107356 I0302 15:32:04.107460 30185 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery-1425339124107356 I0302 15:32:04.107503 30185 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap complete. I0302 15:32:04.108543 30185 ts_tablet_manager.cc:319] Time spent tablet 36005aaac18b4c70b2fc03d1382ca7c3 bootstrap: real 1.272s user 0.682s sys 0.411s I0302 15:32:04.110718 30284 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap replayed 1/2 log segments. Stats: ops{read=1470 overwritten=0 applied=1469} inserts{seen=24680 ignored=19769} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates I0302 15:32:04.111999 30231 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap replayed 1/2 log segments. Stats: ops{read=1460 overwritten=0 applied=1458} inserts{seen=24418 ignored=24418} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates I0302 15:32:04.118221 30185 raft_consensus.cc:194] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Replica starting. Triggering 1 pending transactions. I0302 15:32:04.118420 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.118829 30187 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:04.118844 30185 raft_consensus.cc:211] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:04.118970 30185 raft_consensus.cc:399] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Becoming Follower/Learner. State: Replica: 892c1da145ed4847b1dfd57983516d8f, State: 1, Role: FOLLOWER Watermarks: {Received: term: 2 index: 10275 Committed: term: 1 index: 10274} I0302 15:32:04.120213 30185 consensus_queue.cc:127] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 2.10275, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:04.120367 30185 ts_tablet_manager.cc:339] Time spent starting tablet 36005aaac18b4c70b2fc03d1382ca7c3: real 0.012s user 0.005s sys 0.000s I0302 15:32:04.122409 30187 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 I0302 15:32:04.123062 30187 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap replayed 1/2 log segments. Stats: ops{read=1473 overwritten=0 applied=1472} inserts{seen=24617 ignored=19467} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates I0302 15:32:04.131410 30232 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:04.133179 30232 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 I0302 15:32:04.134726 30232 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap replayed 1/2 log segments. Stats: ops{read=1466 overwritten=0 applied=1465} inserts{seen=24632 ignored=19474} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates I0302 15:32:04.140266 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.159091 30233 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:04.163604 30233 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 I0302 15:32:04.177554 30231 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:04.178360 30231 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3/wal-000000002 I0302 15:32:04.205564 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.238715 30283 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap replayed 2/2 log segments. Stats: ops{read=1790 overwritten=0 applied=1790} inserts{seen=29933 ignored=29933} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0302 15:32:04.238776 30283 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10274, Committed OpId: 1.10274, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:04.250524 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.252100 30283 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery-1425339124252049 I0302 15:32:04.252151 30283 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery-1425339124252049 I0302 15:32:04.252195 30283 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap complete. I0302 15:32:04.253851 30283 ts_tablet_manager.cc:319] Time spent tablet 36005aaac18b4c70b2fc03d1382ca7c3 bootstrap: real 1.288s user 0.604s sys 0.378s I0302 15:32:04.257860 30283 raft_consensus.cc:194] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:04.257932 30283 raft_consensus.cc:211] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:04.258024 30283 raft_consensus.cc:399] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41e55c8a3a40e3bf81f862aaadfd20, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10274 Committed: term: 1 index: 10274} I0302 15:32:04.258100 30283 consensus_queue.cc:127] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10274, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:04.258292 30283 ts_tablet_manager.cc:339] Time spent starting tablet 36005aaac18b4c70b2fc03d1382ca7c3: real 0.004s user 0.002s sys 0.000s I0302 15:32:04.290017 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:40132/tablets I0302 15:32:04.306965 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.343628 30233 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap replayed 2/2 log segments. Stats: ops{read=1817 overwritten=0 applied=1817} inserts{seen=30380 ignored=30380} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0302 15:32:04.343704 30233 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10276, Committed OpId: 1.10276, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:04.352454 30233 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery-1425339124352403 I0302 15:32:04.352507 30233 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery-1425339124352403 I0302 15:32:04.352557 30233 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap complete. I0302 15:32:04.353170 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.353673 30233 ts_tablet_manager.cc:319] Time spent tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 bootstrap: real 1.450s user 0.715s sys 0.444s I0302 15:32:04.357342 30233 raft_consensus.cc:194] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:04.357419 30233 raft_consensus.cc:211] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:04.357524 30233 raft_consensus.cc:399] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10276 Committed: term: 1 index: 10276} I0302 15:32:04.357589 30233 consensus_queue.cc:127] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10276, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:04.357801 30233 ts_tablet_manager.cc:339] Time spent starting tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: real 0.004s user 0.004s sys 0.000s I0302 15:32:04.365217 30285 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:04.366216 30285 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7/wal-000000002 I0302 15:32:04.370203 30285 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap replayed 1/2 log segments. Stats: ops{read=1473 overwritten=0 applied=1472} inserts{seen=24624 ignored=18707} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates I0302 15:32:04.374742 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Couldn't open scanner: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.379230 30231 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap replayed 2/2 log segments. Stats: ops{read=1790 overwritten=0 applied=1790} inserts{seen=29933 ignored=29933} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0302 15:32:04.379297 30231 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10274, Committed OpId: 1.10274, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:04.380725 30231 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery-1425339124380684 I0302 15:32:04.380800 30231 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/36005aaac18b4c70b2fc03d1382ca7c3.recovery-1425339124380684 I0302 15:32:04.380839 30231 tablet_bootstrap.cc:290] Tablet 36005aaac18b4c70b2fc03d1382ca7c3: Bootstrap complete. I0302 15:32:04.381789 30231 ts_tablet_manager.cc:319] Time spent tablet 36005aaac18b4c70b2fc03d1382ca7c3 bootstrap: real 1.486s user 0.665s sys 0.474s I0302 15:32:04.384572 30231 raft_consensus.cc:194] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:04.384629 30231 raft_consensus.cc:211] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:04.384728 30231 raft_consensus.cc:399] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10274 Committed: term: 1 index: 10274} I0302 15:32:04.384780 30231 consensus_queue.cc:127] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10274, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:04.384924 30231 ts_tablet_manager.cc:339] Time spent starting tablet 36005aaac18b4c70b2fc03d1382ca7c3: real 0.003s user 0.000s sys 0.003s I0302 15:32:04.392493 30186 log.cc:415] Max segment size reached. Starting new segment allocation. I0302 15:32:04.392910 30186 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap replayed 1/2 log segments. Stats: ops{read=1437 overwritten=0 applied=1435} inserts{seen=24121 ignored=9574} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates I0302 15:32:04.421645 30186 log.cc:306] Rolled over to a new segment: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4/wal-000000002 I0302 15:32:04.439575 30187 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap replayed 2/2 log segments. Stats: ops{read=1818 overwritten=0 applied=1817} inserts{seen=30380 ignored=19467} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates I0302 15:32:04.439800 30187 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 2.10277, Committed OpId: 1.10276, Pending Replicates: 1, Pending Commits: 0 I0302 15:32:04.439841 30187 tablet_bootstrap.cc:894] Dumping REPLICATES: I0302 15:32:04.439889 30187 tablet_bootstrap.cc:894] type: REPLICATE replicate { id { term: 2 index: 10277 } op_type: CHANGE_CONFIG_OP change_config_request { tablet_id: "4129cb7b8c2b4cdcbcdee9f8ecb69ae7" old_config { opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } } new_config { local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } } } } I0302 15:32:04.442200 30187 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery-1425339124442154 I0302 15:32:04.442250 30187 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery-1425339124442154 I0302 15:32:04.442291 30187 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap complete. I0302 15:32:04.443281 30187 ts_tablet_manager.cc:319] Time spent tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 bootstrap: real 1.599s user 0.717s sys 0.507s I0302 15:32:04.445976 30187 raft_consensus.cc:194] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Replica starting. Triggering 1 pending transactions. I0302 15:32:04.446440 30187 raft_consensus.cc:211] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:04.446492 30187 raft_consensus.cc:399] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Becoming Follower/Learner. State: Replica: 892c1da145ed4847b1dfd57983516d8f, State: 1, Role: FOLLOWER Watermarks: {Received: term: 2 index: 10277 Committed: term: 1 index: 10276} I0302 15:32:04.446527 30187 consensus_queue.cc:127] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 2.10277, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:04.446640 30187 ts_tablet_manager.cc:339] Time spent starting tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: real 0.003s user 0.002s sys 0.001s I0302 15:32:04.449317 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.449625 30284 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap replayed 2/2 log segments. Stats: ops{read=1799 overwritten=0 applied=1798} inserts{seen=30318 ignored=19769} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates I0302 15:32:04.450511 30284 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 2.10275, Committed OpId: 1.10274, Pending Replicates: 1, Pending Commits: 0 I0302 15:32:04.450543 30284 tablet_bootstrap.cc:894] Dumping REPLICATES: I0302 15:32:04.450568 30284 tablet_bootstrap.cc:894] type: REPLICATE replicate { id { term: 2 index: 10275 } op_type: CHANGE_CONFIG_OP change_config_request { tablet_id: "ad1251b8988446ffa0348b542d353bd4" old_config { opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: LEADER last_known_addr { host: "127.0.0.1" port: 7051 } } } new_config { local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } } } } I0302 15:32:04.452725 30284 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery-1425339124452678 I0302 15:32:04.452823 30284 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/ad1251b8988446ffa0348b542d353bd4.recovery-1425339124452678 I0302 15:32:04.452860 30284 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap complete. I0302 15:32:04.453603 30284 ts_tablet_manager.cc:319] Time spent tablet ad1251b8988446ffa0348b542d353bd4 bootstrap: real 1.483s user 0.689s sys 0.396s I0302 15:32:04.455992 30284 raft_consensus.cc:194] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Replica starting. Triggering 1 pending transactions. I0302 15:32:04.456334 30284 raft_consensus.cc:211] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:04.456395 30284 raft_consensus.cc:399] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41e55c8a3a40e3bf81f862aaadfd20, State: 1, Role: FOLLOWER Watermarks: {Received: term: 2 index: 10275 Committed: term: 1 index: 10274} I0302 15:32:04.456434 30284 consensus_queue.cc:127] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 2.10275, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:04.456550 30284 ts_tablet_manager.cc:339] Time spent starting tablet ad1251b8988446ffa0348b542d353bd4: real 0.003s user 0.002s sys 0.000s I0302 15:32:04.469256 30232 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap replayed 2/2 log segments. Stats: ops{read=1798 overwritten=0 applied=1798} inserts{seen=30318 ignored=19474} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0302 15:32:04.469321 30232 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10274, Committed OpId: 1.10274, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:04.471016 30232 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery-1425339124470972 I0302 15:32:04.471050 30232 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-1/wals/ad1251b8988446ffa0348b542d353bd4.recovery-1425339124470972 I0302 15:32:04.471077 30232 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap complete. I0302 15:32:04.471832 30232 ts_tablet_manager.cc:319] Time spent tablet ad1251b8988446ffa0348b542d353bd4 bootstrap: real 1.572s user 0.754s sys 0.499s I0302 15:32:04.473307 30232 raft_consensus.cc:194] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:04.473350 30232 raft_consensus.cc:211] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:04.473400 30232 raft_consensus.cc:399] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10274 Committed: term: 1 index: 10274} I0302 15:32:04.473439 30232 consensus_queue.cc:127] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10274, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:04.473526 30232 ts_tablet_manager.cc:339] Time spent starting tablet ad1251b8988446ffa0348b542d353bd4: real 0.002s user 0.001s sys 0.001s I0302 15:32:04.515774 28280 linked_list-test-util.h:571] Table not yet ready: 0/517150 rows (status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING) I0302 15:32:04.532992 30285 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap replayed 2/2 log segments. Stats: ops{read=1816 overwritten=0 applied=1816} inserts{seen=30364 ignored=18707} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0302 15:32:04.533061 30285 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10276, Committed OpId: 1.10276, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:04.534018 30285 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery-1425339124533986 I0302 15:32:04.534052 30285 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-2/wals/4129cb7b8c2b4cdcbcdee9f8ecb69ae7.recovery-1425339124533986 I0302 15:32:04.534080 30285 tablet_bootstrap.cc:290] Tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: Bootstrap complete. I0302 15:32:04.534742 30285 ts_tablet_manager.cc:319] Time spent tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 bootstrap: real 1.554s user 0.690s sys 0.361s I0302 15:32:04.535737 30285 raft_consensus.cc:194] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:04.535776 30285 raft_consensus.cc:211] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:04.535833 30285 raft_consensus.cc:399] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41e55c8a3a40e3bf81f862aaadfd20, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10276 Committed: term: 1 index: 10276} I0302 15:32:04.535871 30285 consensus_queue.cc:127] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10276, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:04.535948 30285 ts_tablet_manager.cc:339] Time spent starting tablet 4129cb7b8c2b4cdcbcdee9f8ecb69ae7: real 0.001s user 0.001s sys 0.000s I0302 15:32:04.563164 30186 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap replayed 2/2 log segments. Stats: ops{read=1798 overwritten=0 applied=1798} inserts{seen=30318 ignored=9574} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0302 15:32:04.563220 30186 tablet_bootstrap.cc:894] ReplayState: Previous OpId: 1.10274, Committed OpId: 1.10274, Pending Replicates: 0, Pending Commits: 0 I0302 15:32:04.564203 30186 tablet_bootstrap.cc:537] Renamed old recovery dir from: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery to: /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery-1425339124564173 I0302 15:32:04.564236 30186 tablet_bootstrap.cc:540] --skip_remove_old_recovery_dir enabled. NOT removing /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280/linked-list-cluster/ts-0/wals/ad1251b8988446ffa0348b542d353bd4.recovery-1425339124564173 I0302 15:32:04.564262 30186 tablet_bootstrap.cc:290] Tablet ad1251b8988446ffa0348b542d353bd4: Bootstrap complete. I0302 15:32:04.565206 30186 ts_tablet_manager.cc:319] Time spent tablet ad1251b8988446ffa0348b542d353bd4 bootstrap: real 1.726s user 0.877s sys 0.454s I0302 15:32:04.566146 30186 raft_consensus.cc:194] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Replica starting. Triggering 0 pending transactions. I0302 15:32:04.566185 30186 raft_consensus.cc:211] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Initializing failure detector for fast election at startup I0302 15:32:04.566232 30186 raft_consensus.cc:399] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Becoming Follower/Learner. State: Replica: 892c1da145ed4847b1dfd57983516d8f, State: 1, Role: FOLLOWER Watermarks: {Received: term: 1 index: 10274 Committed: term: 1 index: 10274} I0302 15:32:04.566265 30186 consensus_queue.cc:127] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 0.0, Committed index: 0.0, Last appended: 1.10274, Current term: 0, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:04.566342 30186 ts_tablet_manager.cc:339] Time spent starting tablet ad1251b8988446ffa0348b542d353bd4: real 0.001s user 0.000s sys 0.001s I0302 15:32:04.585461 28280 linked_list-test-util.h:656] Done collecting results (515107 rows in 44.9537ms) I0302 15:32:04.605131 30180 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:32:04.605166 30180 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:32:04.605176 30180 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:32:04.605185 30180 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:32:04.605200 30180 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 31581 or (T in {31581})}] I0302 15:32:04.605844 30180 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:04.606083 30180 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:04.606297 30180 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:04.606546 30180 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:04.656052 30180 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deadfeab35f7cfa4c07af4ca05760de17a2 I0302 15:32:04.656200 30180 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:04.656370 30180 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:04.656409 30180 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 31581 or (T in {31581})}] I0302 15:32:04.662101 30180 tablet.cc:1059] Flush successful on 10913 rows (278618 bytes) I0302 15:32:04.662358 30180 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.057s user 0.011s sys 0.004s I0302 15:32:04.662696 28280 linked_list-test-util.h:571] Table not yet ready: 515107/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:04.669638 30226 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:32:04.669668 30226 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:32:04.669678 30226 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:32:04.669687 30226 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:32:04.669700 30226 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 31104 or (T in {31104})}] I0302 15:32:04.670289 30226 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:04.670528 30226 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:04.670758 30226 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:04.671003 30226 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:04.701496 30226 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be5a0601c8f779428180111f974352d4cd I0302 15:32:04.701648 30226 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:04.701819 30226 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:04.701863 30226 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 31104 or (T in {31104})}] I0302 15:32:04.706207 30226 tablet.cc:1059] Flush successful on 10844 rows (276962 bytes) I0302 15:32:04.706379 30226 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.037s user 0.014s sys 0.001s I0302 15:32:04.722563 28280 linked_list-test-util.h:656] Done collecting results (515107 rows in 36.2013ms) I0302 15:32:04.756921 30278 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:32:04.756958 30278 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:32:04.756968 30278 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:32:04.756976 30278 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:32:04.756990 30278 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 31562 or (T in {31562})}] I0302 15:32:04.757611 30278 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:04.757983 30278 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:04.758208 30278 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:04.758431 30278 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:04.803141 28280 linked_list-test-util.h:571] Table not yet ready: 515107/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:04.807232 30278 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b6dddd3b6a3bf843c498c47136fe6e97fe I0302 15:32:04.807353 30278 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:04.807505 30278 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:04.807580 30278 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 31562 or (T in {31562})}] I0302 15:32:04.811147 30278 tablet.cc:1059] Flush successful on 11657 rows (296474 bytes) I0302 15:32:04.811310 30278 maintenance_manager.cc:316] Time spent running FlushMRSOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.055s user 0.008s sys 0.007s I0302 15:32:04.855165 30180 tablet.cc:573] Flush: entering stage 1 (old memrowset already frozen for inserts) I0302 15:32:04.855192 30180 compaction.cc:552] Selected 1 rowsets to compact: I0302 15:32:04.855203 30180 compaction.cc:555] memrowset(current size on disk: ~0 bytes) I0302 15:32:04.855211 30180 tablet.cc:575] Memstore in-memory size: 2039575 bytes I0302 15:32:04.855224 30180 tablet.cc:878] Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 31921 or (T in {31921})}] I0302 15:32:04.855577 30180 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:04.855774 30180 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:04.855954 30180 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:04.856130 30180 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:04.872189 28280 linked_list-test-util.h:656] Done collecting results (516971 rows in 44.1967ms) I0302 15:32:04.907475 30180 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea7097a859187242c89108805a1ea778fb I0302 15:32:04.907575 30180 tablet.cc:964] Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:04.907665 30180 tablet.cc:1026] Flush Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:04.907696 30180 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 31921 or (T in {31921})}] I0302 15:32:04.911178 30180 tablet.cc:1059] Flush successful on 20744 rows (526922 bytes) I0302 15:32:04.911321 30180 maintenance_manager.cc:316] Time spent running FlushMRSOp(ad1251b8988446ffa0348b542d353bd4): real 0.056s user 0.014s sys 0.005s I0302 15:32:04.950137 28280 linked_list-test-util.h:571] Table not yet ready: 516971/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:04.978744 30563 raft_consensus.cc:327] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Failure of peer election-timer detected. Triggering leader election I0302 15:32:04.980358 30563 raft_consensus.cc:1299] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:04.980425 30563 raft_consensus.cc:294] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Starting election with quorum: local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:04.981859 30563 leader_election.cc:187] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 2 election: Requesting vote from peer 892c1da145ed4847b1dfd57983516d8f I0302 15:32:04.981904 30563 leader_election.cc:187] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 2 election: Requesting vote from peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:32:04.983026 30256 raft_consensus.cc:1104] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Leader election vote request: Denying vote to candidate 3e41e55c8a3a40e3bf81f862aaadfd20 in current term 2: Already voted for candidate 892c1da145ed4847b1dfd57983516d8f in this term. I0302 15:32:04.983057 30210 raft_consensus.cc:1104] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Leader election vote request: Denying vote to candidate 3e41e55c8a3a40e3bf81f862aaadfd20 in current term 2: Already voted for candidate 892c1da145ed4847b1dfd57983516d8f in this term. I0302 15:32:04.983187 30281 leader_election.cc:322] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 2 election: Vote denied by peer 892c1da145ed4847b1dfd57983516d8f. Message: Invalid argument: T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Leader election vote request: Denying vote to candidate 3e41e55c8a3a40e3bf81f862aaadfd20 in current term 2: Already voted for candidate 892c1da145ed4847b1dfd57983516d8f in this term. I0302 15:32:04.983221 30281 leader_election.cc:322] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 2 election: Vote denied by peer 5748afe5294c41b89cbb67f8edbee2a1. Message: Invalid argument: T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Leader election vote request: Denying vote to candidate 3e41e55c8a3a40e3bf81f862aaadfd20 in current term 2: Already voted for candidate 892c1da145ed4847b1dfd57983516d8f in this term. I0302 15:32:04.983232 30281 leader_election.cc:281] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. I0302 15:32:04.983258 30281 raft_consensus.cc:1299] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:04.983270 30281 raft_consensus.cc:1214] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Leader election lost for term 2. Reason: None given I0302 15:32:05.007115 28280 linked_list-test-util.h:656] Done collecting results (516971 rows in 33.5046ms) I0302 15:32:05.086067 28280 linked_list-test-util.h:571] Table not yet ready: 516971/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:05.142920 28280 linked_list-test-util.h:656] Done collecting results (512208 rows in 32.6308ms) I0302 15:32:05.211056 28280 linked_list-test-util.h:571] Table not yet ready: 512208/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:05.265638 28280 linked_list-test-util.h:656] Done collecting results (515107 rows in 31.2519ms) I0302 15:32:05.290169 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:55689/jsonmetricz I0302 15:32:05.335945 28280 linked_list-test-util.h:571] Table not yet ready: 515107/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:05.400259 28280 linked_list-test-util.h:656] Done collecting results (512208 rows in 40.0503ms) I0302 15:32:05.476666 28280 linked_list-test-util.h:571] Table not yet ready: 512208/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:05.540784 28280 linked_list-test-util.h:656] Done collecting results (516971 rows in 40.5927ms) I0302 15:32:05.622861 28280 linked_list-test-util.h:571] Table not yet ready: 516971/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:05.687212 28280 linked_list-test-util.h:656] Done collecting results (512208 rows in 41.0447ms) I0302 15:32:05.763746 28280 linked_list-test-util.h:571] Table not yet ready: 512208/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:05.831230 28280 linked_list-test-util.h:656] Done collecting results (515107 rows in 43.7217ms) I0302 15:32:05.910622 28280 linked_list-test-util.h:571] Table not yet ready: 515107/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:05.924971 30555 raft_consensus.cc:327] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Failure of peer election-timer detected. Triggering leader election I0302 15:32:05.926658 30555 raft_consensus.cc:1299] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:05.926748 30555 raft_consensus.cc:294] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Starting election with quorum: local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:05.928381 30555 leader_election.cc:187] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 3 election: Requesting vote from peer 892c1da145ed4847b1dfd57983516d8f I0302 15:32:05.928421 30555 leader_election.cc:187] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 3 election: Requesting vote from peer 3e41e55c8a3a40e3bf81f862aaadfd20 I0302 15:32:05.929421 30211 raft_consensus.cc:1336] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Advancing to term 3 I0302 15:32:05.929540 30310 raft_consensus.cc:1336] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Advancing to term 3 I0302 15:32:05.930613 30211 raft_consensus.cc:1121] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Leader election vote request: Denying vote to candidate 5748afe5294c41b89cbb67f8edbee2a1 for term 3 because replica has last-logged OpId of term: 2 index: 10275, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 10274. I0302 15:32:05.930682 30310 raft_consensus.cc:1299] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:32:05.930794 30229 leader_election.cc:322] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 3 election: Vote denied by peer 892c1da145ed4847b1dfd57983516d8f. Message: Invalid argument: T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Leader election vote request: Denying vote to candidate 5748afe5294c41b89cbb67f8edbee2a1 for term 3 because replica has last-logged OpId of term: 2 index: 10275, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 10274. I0302 15:32:05.931728 30310 raft_consensus.cc:1136] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5748afe5294c41b89cbb67f8edbee2a1 in term 3. I0302 15:32:05.931877 30229 leader_election.cc:308] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 3 election: Vote granted by peer 3e41e55c8a3a40e3bf81f862aaadfd20 I0302 15:32:05.931903 30229 leader_election.cc:281] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. I0302 15:32:05.931942 30229 raft_consensus.cc:1299] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:05.931965 30229 raft_consensus.cc:1237] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Leader election won for term 3 I0302 15:32:05.932060 30229 raft_consensus.cc:361] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: Becoming Leader. State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: LEADER Watermarks: {Received: term: 1 index: 10274 Committed: term: 1 index: 10274} I0302 15:32:05.932102 30229 consensus_queue.cc:119] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 1.10274, Committed index: 1.10274, Last appended: 1.10274, Current term: 3, Majority size: 2, State: 1, Mode: LEADER W0302 15:32:05.933109 30611 raft_consensus_state.cc:477] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 1 index: 10274 New majority replicated is: term: 1 index: 10274. Current term is: 3 I0302 15:32:05.972964 28280 linked_list-test-util.h:656] Done collecting results (515107 rows in 38.6746ms) I0302 15:32:05.973399 30558 raft_consensus.cc:327] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Failure of peer election-timer detected. Triggering leader election I0302 15:32:05.974566 30558 raft_consensus.cc:1299] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:05.974618 30558 raft_consensus.cc:294] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Starting election with quorum: local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:05.975666 30558 leader_election.cc:187] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 3 election: Requesting vote from peer 3e41e55c8a3a40e3bf81f862aaadfd20 I0302 15:32:05.975710 30558 leader_election.cc:187] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 3 election: Requesting vote from peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:32:05.976716 30257 raft_consensus.cc:1336] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Advancing to term 3 I0302 15:32:05.978111 30257 raft_consensus.cc:1299] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:32:05.978360 30311 raft_consensus.cc:1336] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Advancing to term 3 I0302 15:32:05.979375 30311 raft_consensus.cc:1299] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:05.979396 30257 raft_consensus.cc:1136] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 892c1da145ed4847b1dfd57983516d8f in term 3. I0302 15:32:05.979516 30183 leader_election.cc:308] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 3 election: Vote granted by peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:32:05.979535 30183 leader_election.cc:281] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. I0302 15:32:05.979565 30183 raft_consensus.cc:1299] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:05.979590 30183 raft_consensus.cc:1237] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Leader election won for term 3 I0302 15:32:05.979661 30183 raft_consensus.cc:361] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Becoming Leader. State: Replica: 892c1da145ed4847b1dfd57983516d8f, State: 1, Role: LEADER Watermarks: {Received: term: 2 index: 10277 Committed: term: 1 index: 10276} I0302 15:32:05.979691 30183 consensus_queue.cc:119] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 1.10276, Committed index: 1.10276, Last appended: 2.10277, Current term: 3, Majority size: 2, State: 1, Mode: LEADER I0302 15:32:05.980108 30311 raft_consensus.cc:1136] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Leader election vote request: Granting yes vote for candidate 892c1da145ed4847b1dfd57983516d8f in term 3. I0302 15:32:05.980365 30183 leader_election.cc:308] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 3 election: Vote granted by peer 3e41e55c8a3a40e3bf81f862aaadfd20 W0302 15:32:05.980448 30616 raft_consensus_state.cc:477] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 1 index: 10276 New majority replicated is: term: 1 index: 10276. Current term is: 3 I0302 15:32:06.040448 30542 raft_consensus.cc:327] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Failure of peer election-timer detected. Triggering leader election I0302 15:32:06.041525 30542 raft_consensus.cc:1299] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:06.041563 30542 raft_consensus.cc:294] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Starting election with quorum: local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:06.042688 30542 leader_election.cc:187] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 4 election: Requesting vote from peer 3e41e55c8a3a40e3bf81f862aaadfd20 I0302 15:32:06.042726 30542 leader_election.cc:187] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 4 election: Requesting vote from peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:32:06.042956 30258 raft_consensus.cc:1322] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: Stepping down as leader of term 3 I0302 15:32:06.042956 30312 raft_consensus.cc:1336] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Advancing to term 4 I0302 15:32:06.043000 30258 raft_consensus.cc:399] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: Becoming Follower/Learner. State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: LEADER Watermarks: {Received: term: 3 index: 10275 Committed: term: 1 index: 10274} I0302 15:32:06.043037 30258 consensus_queue.cc:127] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 1.10274, Committed index: 1.10274, Last appended: 3.10275, Current term: 3, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:06.043129 30258 consensus_peers.cc:211] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1: Closing peer: 3e41e55c8a3a40e3bf81f862aaadfd20 I0302 15:32:06.043196 30258 consensus_peers.cc:211] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1: Closing peer: 892c1da145ed4847b1dfd57983516d8f I0302 15:32:06.043298 30258 raft_consensus.cc:1336] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Advancing to term 4 I0302 15:32:06.044283 30312 raft_consensus.cc:1299] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:32:06.044606 30258 raft_consensus.cc:1121] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Leader election vote request: Denying vote to candidate 892c1da145ed4847b1dfd57983516d8f for term 4 because replica has last-logged OpId of term: 3 index: 10275, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 10275. I0302 15:32:06.044790 30183 leader_election.cc:322] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 4 election: Vote denied by peer 5748afe5294c41b89cbb67f8edbee2a1. Message: Invalid argument: T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Leader election vote request: Denying vote to candidate 892c1da145ed4847b1dfd57983516d8f for term 4 because replica has last-logged OpId of term: 3 index: 10275, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 10275. I0302 15:32:06.045491 30312 raft_consensus.cc:1136] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 892c1da145ed4847b1dfd57983516d8f in term 4. I0302 15:32:06.045600 30183 leader_election.cc:308] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 4 election: Vote granted by peer 3e41e55c8a3a40e3bf81f862aaadfd20 I0302 15:32:06.045624 30183 leader_election.cc:281] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. I0302 15:32:06.045651 30183 raft_consensus.cc:1299] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:06.045673 30183 raft_consensus.cc:1237] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [CANDIDATE]: Leader election won for term 4 I0302 15:32:06.045727 30183 raft_consensus.cc:361] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Becoming Leader. State: Replica: 892c1da145ed4847b1dfd57983516d8f, State: 1, Role: LEADER Watermarks: {Received: term: 2 index: 10275 Committed: term: 1 index: 10274} I0302 15:32:06.045752 30183 consensus_queue.cc:119] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 1.10274, Committed index: 1.10274, Last appended: 2.10275, Current term: 4, Majority size: 2, State: 1, Mode: LEADER W0302 15:32:06.046550 30620 raft_consensus_state.cc:477] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 1 index: 10274 New majority replicated is: term: 1 index: 10274. Current term is: 4 I0302 15:32:06.053925 28280 linked_list-test-util.h:571] Table not yet ready: 515107/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:06.065887 30562 raft_consensus.cc:327] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Failure of peer election-timer detected. Triggering leader election I0302 15:32:06.066781 30562 raft_consensus.cc:1299] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:06.066820 30562 raft_consensus.cc:294] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Starting election with quorum: local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:06.067832 30562 leader_election.cc:187] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 3 election: Requesting vote from peer 892c1da145ed4847b1dfd57983516d8f I0302 15:32:06.067864 30562 leader_election.cc:187] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 3 election: Requesting vote from peer 3e41e55c8a3a40e3bf81f862aaadfd20 I0302 15:32:06.068048 30313 raft_consensus.cc:1336] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Advancing to term 3 I0302 15:32:06.068056 30212 raft_consensus.cc:1336] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Advancing to term 3 I0302 15:32:06.068867 30313 raft_consensus.cc:1121] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Leader election vote request: Denying vote to candidate 5748afe5294c41b89cbb67f8edbee2a1 for term 3 because replica has last-logged OpId of term: 2 index: 10275, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 10274. I0302 15:32:06.069010 30229 leader_election.cc:322] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 3 election: Vote denied by peer 3e41e55c8a3a40e3bf81f862aaadfd20. Message: Invalid argument: T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Leader election vote request: Denying vote to candidate 5748afe5294c41b89cbb67f8edbee2a1 for term 3 because replica has last-logged OpId of term: 2 index: 10275, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 10274. I0302 15:32:06.069010 30212 raft_consensus.cc:1299] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:32:06.070018 30212 raft_consensus.cc:1136] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5748afe5294c41b89cbb67f8edbee2a1 in term 3. I0302 15:32:06.070140 30229 leader_election.cc:308] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 3 election: Vote granted by peer 892c1da145ed4847b1dfd57983516d8f I0302 15:32:06.070158 30229 leader_election.cc:281] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. I0302 15:32:06.070173 30229 raft_consensus.cc:1299] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:06.070184 30229 raft_consensus.cc:1237] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [CANDIDATE]: Leader election won for term 3 I0302 15:32:06.070238 30229 raft_consensus.cc:361] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: Becoming Leader. State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: LEADER Watermarks: {Received: term: 1 index: 10274 Committed: term: 1 index: 10274} I0302 15:32:06.070258 30229 consensus_queue.cc:119] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 1.10274, Committed index: 1.10274, Last appended: 1.10274, Current term: 3, Majority size: 2, State: 1, Mode: LEADER W0302 15:32:06.070879 30624 raft_consensus_state.cc:477] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 1 index: 10274 New majority replicated is: term: 1 index: 10274. Current term is: 3 I0302 15:32:06.110584 28280 linked_list-test-util.h:656] Done collecting results (512208 rows in 33.1791ms) I0302 15:32:06.178658 28280 linked_list-test-util.h:571] Table not yet ready: 512208/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:06.244578 28280 linked_list-test-util.h:656] Done collecting results (515107 rows in 41.4619ms) I0302 15:32:06.290313 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:55689/tablets I0302 15:32:06.323060 28280 linked_list-test-util.h:571] Table not yet ready: 515107/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:06.382552 28280 linked_list-test-util.h:656] Done collecting results (516971 rows in 36.0671ms) I0302 15:32:06.469805 28280 linked_list-test-util.h:571] Table not yet ready: 516971/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:06.480195 30314 raft_consensus.cc:642] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Refusing update from remote peer 892c1da145ed4847b1dfd57983516d8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10276. Preceding OpId from leader: term: 3 index: 10278. I0302 15:32:06.480360 30259 raft_consensus.cc:642] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Refusing update from remote peer 892c1da145ed4847b1dfd57983516d8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10276. Preceding OpId from leader: term: 3 index: 10278. I0302 15:32:06.480376 30183 consensus_queue.cc:428] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Connected to new peer: Peer: 3e41e55c8a3a40e3bf81f862aaadfd20, New: false, Last received: 1.10276, Last sent , Last known committed idx: 10276 Last exchange result: ERROR I0302 15:32:06.480661 30183 consensus_queue.cc:428] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Connected to new peer: Peer: 5748afe5294c41b89cbb67f8edbee2a1, New: false, Last received: 1.10276, Last sent , Last known committed idx: 10276 Last exchange result: ERROR I0302 15:32:06.480787 30627 log_cache.cc:332] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f: Loaded operations into the cache after: 1.10276 to: 2.10277 for a total of: 2. Current state: Preceding Op: 1.10276, Pinned index: 0, LogCacheStats(num_ops=1, bytes=1262) I0302 15:32:06.480911 30315 raft_consensus.cc:642] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Refusing update from remote peer 892c1da145ed4847b1dfd57983516d8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10276. Preceding OpId from leader: term: 3 index: 10278. I0302 15:32:06.480912 30260 raft_consensus.cc:642] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Refusing update from remote peer 892c1da145ed4847b1dfd57983516d8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10276. Preceding OpId from leader: term: 3 index: 10278. I0302 15:32:06.481046 30183 consensus_queue.cc:431] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Got LMP mismatch error from peer: Peer: 5748afe5294c41b89cbb67f8edbee2a1, New: false, Last received: 1.10276, Last sent , Last known committed idx: 10276 Last exchange result: ERROR I0302 15:32:06.481079 30183 consensus_queue.cc:431] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Got LMP mismatch error from peer: Peer: 3e41e55c8a3a40e3bf81f862aaadfd20, New: false, Last received: 1.10276, Last sent , Last known committed idx: 10276 Last exchange result: ERROR I0302 15:32:06.507441 30560 raft_consensus.cc:327] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Failure of peer election-timer detected. Triggering leader election I0302 15:32:06.509002 30560 raft_consensus.cc:1299] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:06.509059 30560 raft_consensus.cc:294] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Starting election with quorum: local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: CANDIDATE last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:06.510617 30560 leader_election.cc:187] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 4 election: Requesting vote from peer 892c1da145ed4847b1dfd57983516d8f I0302 15:32:06.510666 30560 leader_election.cc:187] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 4 election: Requesting vote from peer 5748afe5294c41b89cbb67f8edbee2a1 I0302 15:32:06.510854 30213 raft_consensus.cc:1336] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Advancing to term 4 I0302 15:32:06.510880 30261 raft_consensus.cc:1322] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: Stepping down as leader of term 3 I0302 15:32:06.510907 30261 raft_consensus.cc:399] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [LEADER]: Becoming Follower/Learner. State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: LEADER Watermarks: {Received: term: 3 index: 10275 Committed: term: 1 index: 10274} I0302 15:32:06.510927 30261 consensus_queue.cc:127] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [NON_LEADER]: queue going to NON_LEADER mode. State: All replicated op: 0.0, Majority replicated op: 1.10274, Committed index: 1.10274, Last appended: 3.10275, Current term: 3, Majority size: 1, State: 1, Mode: NON_LEADER I0302 15:32:06.511024 30261 consensus_peers.cc:211] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1: Closing peer: 3e41e55c8a3a40e3bf81f862aaadfd20 I0302 15:32:06.511102 30261 consensus_peers.cc:211] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1: Closing peer: 892c1da145ed4847b1dfd57983516d8f I0302 15:32:06.511159 30261 raft_consensus.cc:1336] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Advancing to term 4 I0302 15:32:06.512104 30261 raft_consensus.cc:1121] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Leader election vote request: Denying vote to candidate 3e41e55c8a3a40e3bf81f862aaadfd20 for term 4 because replica has last-logged OpId of term: 3 index: 10275, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 10275. I0302 15:32:06.512224 30281 leader_election.cc:322] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 4 election: Vote denied by peer 5748afe5294c41b89cbb67f8edbee2a1. Message: Invalid argument: T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Leader election vote request: Denying vote to candidate 3e41e55c8a3a40e3bf81f862aaadfd20 for term 4 because replica has last-logged OpId of term: 3 index: 10275, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 10275. I0302 15:32:06.512275 30213 raft_consensus.cc:1299] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Snoozing failure detection for an additional: 1.500s I0302 15:32:06.513681 30213 raft_consensus.cc:1136] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41e55c8a3a40e3bf81f862aaadfd20 in term 4. I0302 15:32:06.513803 30281 leader_election.cc:308] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 4 election: Vote granted by peer 892c1da145ed4847b1dfd57983516d8f I0302 15:32:06.513820 30281 leader_election.cc:281] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. I0302 15:32:06.513839 30281 raft_consensus.cc:1299] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Snoozing failure detection for an additional: 1.500s I0302 15:32:06.513850 30281 raft_consensus.cc:1237] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [CANDIDATE]: Leader election won for term 4 I0302 15:32:06.513907 30281 raft_consensus.cc:361] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: Becoming Leader. State: Replica: 3e41e55c8a3a40e3bf81f862aaadfd20, State: 1, Role: LEADER Watermarks: {Received: term: 2 index: 10275 Committed: term: 1 index: 10274} I0302 15:32:06.513936 30281 consensus_queue.cc:119] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: queue going to LEADER mode. State: All replicated op: 0.0, Majority replicated op: 1.10274, Committed index: 1.10274, Last appended: 2.10275, Current term: 4, Majority size: 2, State: 1, Mode: LEADER W0302 15:32:06.514775 30631 raft_consensus_state.cc:477] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: Can't advance the committed index across term boundaries yet. Last committed operation was: term: 1 index: 10274 New majority replicated is: term: 1 index: 10274. Current term is: 4 I0302 15:32:06.541015 28280 linked_list-test-util.h:656] Done collecting results (512208 rows in 47.8704ms) I0302 15:32:06.546309 30316 raft_consensus.cc:642] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Refusing update from remote peer 892c1da145ed4847b1dfd57983516d8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10274. Preceding OpId from leader: term: 4 index: 10276. I0302 15:32:06.546389 30262 raft_consensus.cc:642] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Refusing update from remote peer 892c1da145ed4847b1dfd57983516d8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 10275. Preceding OpId from leader: term: 4 index: 10276. I0302 15:32:06.546519 30183 consensus_queue.cc:428] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Connected to new peer: Peer: 5748afe5294c41b89cbb67f8edbee2a1, New: false, Last received: 3.10275, Last sent , Last known committed idx: 10274 Last exchange result: ERROR I0302 15:32:06.546679 30183 consensus_queue.cc:428] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Connected to new peer: Peer: 3e41e55c8a3a40e3bf81f862aaadfd20, New: false, Last received: 1.10274, Last sent , Last known committed idx: 10274 Last exchange result: ERROR I0302 15:32:06.546816 30632 log_cache.cc:332] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f: Loaded operations into the cache after: 1.10274 to: 2.10275 for a total of: 2. Current state: Preceding Op: 1.10274, Pinned index: 0, LogCacheStats(num_ops=1, bytes=1262) I0302 15:32:06.546890 30317 raft_consensus.cc:642] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20 [FOLLOWER]: Refusing update from remote peer 892c1da145ed4847b1dfd57983516d8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10274. Preceding OpId from leader: term: 4 index: 10276. I0302 15:32:06.546896 30263 raft_consensus.cc:642] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Refusing update from remote peer 892c1da145ed4847b1dfd57983516d8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 10275. Preceding OpId from leader: term: 4 index: 10276. I0302 15:32:06.547021 30183 consensus_queue.cc:431] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Got LMP mismatch error from peer: Peer: 5748afe5294c41b89cbb67f8edbee2a1, New: false, Last received: 3.10275, Last sent , Last known committed idx: 10274 Last exchange result: ERROR I0302 15:32:06.547049 30183 consensus_queue.cc:431] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Got LMP mismatch error from peer: Peer: 3e41e55c8a3a40e3bf81f862aaadfd20, New: false, Last received: 1.10274, Last sent , Last known committed idx: 10274 Last exchange result: ERROR I0302 15:32:06.622967 28280 linked_list-test-util.h:571] Table not yet ready: 512208/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:06.699065 28280 linked_list-test-util.h:656] Done collecting results (516971 rows in 51.8008ms) I0302 15:32:06.791839 28280 linked_list-test-util.h:571] Table not yet ready: 516971/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:06.867329 28280 linked_list-test-util.h:656] Done collecting results (516971 rows in 51.9193ms) I0302 15:32:06.968230 28280 linked_list-test-util.h:571] Table not yet ready: 516971/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:06.983710 30272 change_config_transaction.cc:135] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10277 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:06.985353 30635 raft_consensus_state.cc:470] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Advanced the committed_index across terms. Last committed operation was: term: 1 index: 10276 New committed index is: term: 3 index: 10278 I0302 15:32:06.985448 30272 change_config_transaction.cc:135] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 892c1da145ed4847b1dfd57983516d8f: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10278 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.014493 30214 raft_consensus.cc:642] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f [FOLLOWER]: Refusing update from remote peer 3e41e55c8a3a40e3bf81f862aaadfd20: Log matching property violated. Preceding OpId in replica: term: 1 index: 10274. Preceding OpId from leader: term: 4 index: 10276. I0302 15:32:07.014538 30265 raft_consensus.cc:642] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Refusing update from remote peer 3e41e55c8a3a40e3bf81f862aaadfd20: Log matching property violated. Preceding OpId in replica: term: 3 index: 10275. Preceding OpId from leader: term: 4 index: 10276. I0302 15:32:07.014868 30281 consensus_queue.cc:428] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: Connected to new peer: Peer: 5748afe5294c41b89cbb67f8edbee2a1, New: false, Last received: 3.10275, Last sent , Last known committed idx: 10274 Last exchange result: ERROR I0302 15:32:07.015326 30637 log_cache.cc:332] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20: Loaded operations into the cache after: 1.10274 to: 2.10275 for a total of: 2. Current state: Preceding Op: 1.10274, Pinned index: 0, LogCacheStats(num_ops=1, bytes=1262) I0302 15:32:07.015393 30281 consensus_queue.cc:428] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: Connected to new peer: Peer: 892c1da145ed4847b1dfd57983516d8f, New: false, Last received: 1.10274, Last sent , Last known committed idx: 10274 Last exchange result: ERROR I0302 15:32:07.015599 30256 raft_consensus.cc:642] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Refusing update from remote peer 3e41e55c8a3a40e3bf81f862aaadfd20: Log matching property violated. Preceding OpId in replica: term: 3 index: 10275. Preceding OpId from leader: term: 4 index: 10276. I0302 15:32:07.015753 30281 consensus_queue.cc:431] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: Got LMP mismatch error from peer: Peer: 5748afe5294c41b89cbb67f8edbee2a1, New: false, Last received: 3.10275, Last sent , Last known committed idx: 10274 Last exchange result: ERROR I0302 15:32:07.018283 30343 change_config_transaction.cc:135] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: LEADER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10275 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.018997 30639 raft_consensus_state.cc:470] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20 [LEADER]: Advanced the committed_index across terms. Last committed operation was: term: 1 index: 10274 New committed index is: term: 4 index: 10276 I0302 15:32:07.019100 30343 change_config_transaction.cc:135] T ad1251b8988446ffa0348b542d353bd4 P 3e41e55c8a3a40e3bf81f862aaadfd20: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: LEADER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10276 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.045297 28280 linked_list-test-util.h:656] Done collecting results (512208 rows in 53.6108ms) I0302 15:32:07.046715 30257 raft_consensus_state.cc:389] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Aborting all transactions after (but not including): 10274. Current State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: FOLLOWER Watermarks: {Received: term: 3 index: 10275 Committed: term: 1 index: 10274} I0302 15:32:07.046746 30257 raft_consensus_state.cc:414] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Aborting uncommitted operation due to leader change: 3.10275 I0302 15:32:07.049036 30274 change_config_transaction.cc:135] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10275 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.050223 30644 raft_consensus_state.cc:470] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f [LEADER]: Advanced the committed_index across terms. Last committed operation was: term: 1 index: 10274 New committed index is: term: 4 index: 10276 I0302 15:32:07.050300 30274 change_config_transaction.cc:135] T 36005aaac18b4c70b2fc03d1382ca7c3 P 892c1da145ed4847b1dfd57983516d8f: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10276 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.127820 28280 linked_list-test-util.h:571] Table not yet ready: 512208/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:07.201939 28280 linked_list-test-util.h:656] Done collecting results (512208 rows in 50.4796ms) I0302 15:32:07.284370 28280 linked_list-test-util.h:571] Table not yet ready: 512208/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:07.290470 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:43948/jsonmetricz I0302 15:32:07.361310 28280 linked_list-test-util.h:656] Done collecting results (516971 rows in 52.639ms) I0302 15:32:07.465647 28280 linked_list-test-util.h:571] Table not yet ready: 516971/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:07.482161 30327 change_config_transaction.cc:135] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10277 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.482435 30344 change_config_transaction.cc:135] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10277 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.483381 30327 change_config_transaction.cc:135] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 5748afe5294c41b89cbb67f8edbee2a1: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10278 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.483628 30344 change_config_transaction.cc:135] T 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 P 3e41e55c8a3a40e3bf81f862aaadfd20: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10278 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.514776 30259 raft_consensus_state.cc:389] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Aborting all transactions after (but not including): 10274. Current State: Replica: 5748afe5294c41b89cbb67f8edbee2a1, State: 1, Role: FOLLOWER Watermarks: {Received: term: 3 index: 10275 Committed: term: 1 index: 10274} I0302 15:32:07.514802 30259 raft_consensus_state.cc:414] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1 [FOLLOWER]: Aborting uncommitted operation due to leader change: 3.10275 I0302 15:32:07.516572 30331 change_config_transaction.cc:135] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: LEADER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10275 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.517488 30277 change_config_transaction.cc:135] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: LEADER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10275 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.517690 30331 change_config_transaction.cc:135] T ad1251b8988446ffa0348b542d353bd4 P 5748afe5294c41b89cbb67f8edbee2a1: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: LEADER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10276 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.518654 30277 change_config_transaction.cc:135] T ad1251b8988446ffa0348b542d353bd4 P 892c1da145ed4847b1dfd57983516d8f: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: LEADER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10276 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.533769 28280 linked_list-test-util.h:656] Done collecting results (512208 rows in 44.5577ms) I0302 15:32:07.548213 30336 change_config_transaction.cc:135] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10275 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.548854 30288 change_config_transaction.cc:135] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10275 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.549237 30336 change_config_transaction.cc:135] T 36005aaac18b4c70b2fc03d1382ca7c3 P 3e41e55c8a3a40e3bf81f862aaadfd20: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10276 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.549245 30288 change_config_transaction.cc:135] T 36005aaac18b4c70b2fc03d1382ca7c3 P 5748afe5294c41b89cbb67f8edbee2a1: Configuration changed Changed from: opid_index: 1 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } Changed to: opid_index: 10276 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.610112 28280 linked_list-test-util.h:571] Table not yet ready: 512208/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:07.668712 28280 linked_list-test-util.h:656] Done collecting results (515107 rows in 35.2124ms) I0302 15:32:07.744218 28280 linked_list-test-util.h:571] Table not yet ready: 515107/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:07.811719 28280 linked_list-test-util.h:656] Done collecting results (515107 rows in 43.6235ms) I0302 15:32:07.862687 28297 catalog_manager.cc:1283] Tablet: 4129cb7b8c2b4cdcbcdee9f8ecb69ae7 reported quorum change. New quorum: opid_index: 10278 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.863904 28297 catalog_manager.cc:1283] Tablet: ad1251b8988446ffa0348b542d353bd4 reported quorum change. New quorum: opid_index: 10276 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: LEADER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.864284 28297 catalog_manager.cc:1283] Tablet: 36005aaac18b4c70b2fc03d1382ca7c3 reported quorum change. New quorum: opid_index: 10276 local: false peers { permanent_uuid: "892c1da145ed4847b1dfd57983516d8f" role: LEADER last_known_addr { host: "127.0.0.1" port: 7050 } } peers { permanent_uuid: "3e41e55c8a3a40e3bf81f862aaadfd20" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7052 } } peers { permanent_uuid: "5748afe5294c41b89cbb67f8edbee2a1" role: FOLLOWER last_known_addr { host: "127.0.0.1" port: 7051 } } I0302 15:32:07.892282 28280 linked_list-test-util.h:571] Table not yet ready: 515107/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:07.956368 28280 linked_list-test-util.h:656] Done collecting results (512208 rows in 40.2194ms) I0302 15:32:08.028822 28280 linked_list-test-util.h:571] Table not yet ready: 512208/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:08.089702 28280 linked_list-test-util.h:656] Done collecting results (516971 rows in 37.0895ms) I0302 15:32:08.171455 28280 linked_list-test-util.h:571] Table not yet ready: 516971/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:08.233201 28280 linked_list-test-util.h:656] Done collecting results (515107 rows in 37.9712ms) I0302 15:32:08.290638 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:43948/tablets I0302 15:32:08.308260 28280 linked_list-test-util.h:571] Table not yet ready: 515107/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:08.378775 28280 linked_list-test-util.h:656] Done collecting results (512208 rows in 46.4721ms) I0302 15:32:08.463295 28280 linked_list-test-util.h:571] Table not yet ready: 512208/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:08.535569 28280 linked_list-test-util.h:656] Done collecting results (516971 rows in 48.9851ms) I0302 15:32:08.627140 28280 linked_list-test-util.h:571] Table not yet ready: 516971/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:08.699735 28280 linked_list-test-util.h:656] Done collecting results (515107 rows in 47.7857ms) I0302 15:32:08.782465 28280 linked_list-test-util.h:571] Table not yet ready: 515107/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:08.855113 28280 linked_list-test-util.h:656] Done collecting results (516971 rows in 48.5559ms) I0302 15:32:08.955171 28280 linked_list-test-util.h:571] Table not yet ready: 516971/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:09.026746 28280 linked_list-test-util.h:656] Done collecting results (512208 rows in 46.9756ms) I0302 15:32:09.107004 28280 linked_list-test-util.h:571] Table not yet ready: 512208/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:09.172668 28280 linked_list-test-util.h:656] Done collecting results (512208 rows in 41.5488ms) I0302 15:32:09.259107 30278 tablet.cc:1081] Compaction: stage 1 complete, picked 4 rowsets to compact I0302 15:32:09.259132 30278 compaction.cc:552] Selected 4 rowsets to compact: I0302 15:32:09.259145 30278 compaction.cc:555] RowSet(13)(current size on disk: ~3085353 bytes) I0302 15:32:09.259152 30278 compaction.cc:555] RowSet(14)(current size on disk: ~445137 bytes) I0302 15:32:09.259161 30278 compaction.cc:555] RowSet(15)(current size on disk: ~286253 bytes) I0302 15:32:09.259169 30278 compaction.cc:555] RowSet(16)(current size on disk: ~314213 bytes) I0302 15:32:09.259182 30278 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 30844 or (T in {30844})}] I0302 15:32:09.259737 30278 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:09.259970 30278 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:09.260149 30278 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:09.260273 28280 linked_list-test-util.h:571] Table not yet ready: 512208/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:09.260397 30278 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:09.290799 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/jsonmetricz I0302 15:32:09.328294 28280 linked_list-test-util.h:656] Done collecting results (516971 rows in 44.1951ms) I0302 15:32:09.357548 30180 tablet.cc:1081] Compaction: stage 1 complete, picked 2 rowsets to compact I0302 15:32:09.357574 30180 compaction.cc:552] Selected 2 rowsets to compact: I0302 15:32:09.357585 30180 compaction.cc:555] RowSet(16)(current size on disk: ~3836425 bytes) I0302 15:32:09.357597 30180 compaction.cc:555] RowSet(17)(current size on disk: ~293837 bytes) I0302 15:32:09.357628 30180 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 30869 or (T in {30869})}] I0302 15:32:09.358194 30180 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:09.358415 30180 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:09.358654 30180 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:09.358847 30180 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:09.421986 30226 tablet.cc:1081] Compaction: stage 1 complete, picked 4 rowsets to compact I0302 15:32:09.422014 30226 compaction.cc:552] Selected 4 rowsets to compact: I0302 15:32:09.422024 30226 compaction.cc:555] RowSet(13)(current size on disk: ~3080121 bytes) I0302 15:32:09.422034 30226 compaction.cc:555] RowSet(14)(current size on disk: ~444177 bytes) I0302 15:32:09.422046 30226 compaction.cc:555] RowSet(15)(current size on disk: ~285317 bytes) I0302 15:32:09.422055 30226 compaction.cc:555] RowSet(16)(current size on disk: ~321341 bytes) I0302 15:32:09.422075 30226 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 30956 or (T in {30956})}] I0302 15:32:09.422643 30226 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:09.422843 30226 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:09.423027 30226 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:09.423202 30226 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:09.453234 28280 linked_list-test-util.h:571] Table not yet ready: 516971/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:09.530702 28280 linked_list-test-util.h:656] Done collecting results (512208 rows in 52.8512ms) I0302 15:32:09.568922 30278 delta_tracker.cc:69] Successfully opened REDO delta file c9cbc432f1724eaea323b101cf10d8b66a0a4e51bc7343f4a572c1970d525b6b I0302 15:32:09.569139 30278 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b62b0bd3ecd9f94645bf236946c4deca10 I0302 15:32:09.569237 30278 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:09.569356 30278 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:09.569376 30278 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 30844 or (T in {30844})}] I0302 15:32:09.608144 28280 linked_list-test-util.h:571] Table not yet ready: 512208/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:09.614176 30278 tablet.cc:1059] Compaction successful on 172047 rows (4339914 bytes) I0302 15:32:09.623432 30278 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.364s user 0.163s sys 0.038s I0302 15:32:09.681625 28280 linked_list-test-util.h:656] Done collecting results (516971 rows in 48.8857ms) I0302 15:32:09.759280 30278 tablet.cc:1081] Compaction: stage 1 complete, picked 2 rowsets to compact I0302 15:32:09.759309 30278 compaction.cc:552] Selected 2 rowsets to compact: I0302 15:32:09.759322 30278 compaction.cc:555] RowSet(16)(current size on disk: ~3864313 bytes) I0302 15:32:09.759337 30278 compaction.cc:555] RowSet(17)(current size on disk: ~280157 bytes) I0302 15:32:09.759356 30278 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 31562 or (T in {31562})}] I0302 15:32:09.759865 30278 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:09.760100 30278 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:09.760351 30278 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:09.760639 30278 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:09.793702 28280 linked_list-test-util.h:571] Table not yet ready: 516971/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:09.864541 28280 linked_list-test-util.h:656] Done collecting results (516971 rows in 47.2186ms) I0302 15:32:09.869328 30180 delta_tracker.cc:69] Successfully opened REDO delta file cb8ec8ace5794df5bd0c9c859c1b8dea143b4a976203493caaaef25661db43ef I0302 15:32:09.869328 30226 delta_tracker.cc:69] Successfully opened REDO delta file 8742962816284c9e8fad0726169d72be8a1faa11776148cdb9f577f86d6ce465 I0302 15:32:09.869529 30180 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deaf4e614aa7676412695c434bc23b1c300 I0302 15:32:09.869562 30226 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be545715400760487183ec6a38c8f6456c I0302 15:32:09.869626 30180 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:09.869652 30226 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:09.869737 30180 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:09.869752 30226 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:09.869760 30180 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 30869 or (T in {30869})}] I0302 15:32:09.869771 30226 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 30956 or (T in {30956})}] I0302 15:32:09.911840 30180 tablet.cc:1059] Compaction successful on 172047 rows (4339914 bytes) I0302 15:32:09.917490 30180 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.560s user 0.159s sys 0.039s I0302 15:32:09.917657 30226 tablet.cc:1059] Compaction successful on 172047 rows (4339914 bytes) I0302 15:32:09.922026 30226 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(36005aaac18b4c70b2fc03d1382ca7c3): real 0.500s user 0.197s sys 0.027s I0302 15:32:09.923122 30226 tablet.cc:1081] Compaction: stage 1 complete, picked 2 rowsets to compact I0302 15:32:09.923154 30226 compaction.cc:552] Selected 2 rowsets to compact: I0302 15:32:09.923180 30226 compaction.cc:555] RowSet(16)(current size on disk: ~3856417 bytes) I0302 15:32:09.923205 30226 compaction.cc:555] RowSet(17)(current size on disk: ~288053 bytes) I0302 15:32:09.923233 30226 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 30851 or (T in {30851})}] I0302 15:32:09.923629 30226 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:09.923859 30226 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:09.924059 30226 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:09.924331 30226 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:09.950213 28280 linked_list-test-util.h:571] Table not yet ready: 516971/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:10.043506 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 54.1896ms) I0302 15:32:10.108052 30180 tablet.cc:1081] Compaction: stage 1 complete, picked 3 rowsets to compact I0302 15:32:10.108078 30180 compaction.cc:552] Selected 3 rowsets to compact: I0302 15:32:10.108089 30180 compaction.cc:555] RowSet(13)(current size on disk: ~3239089 bytes) I0302 15:32:10.108098 30180 compaction.cc:555] RowSet(14)(current size on disk: ~403329 bytes) I0302 15:32:10.108106 30180 compaction.cc:555] RowSet(15)(current size on disk: ~498249 bytes) I0302 15:32:10.108120 30180 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 31921 or (T in {31921})}] I0302 15:32:10.124630 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:10.125859 30180 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:10.128865 30180 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:10.129066 30180 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:10.129240 30180 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:10.164537 30278 delta_tracker.cc:69] Successfully opened UNDO delta file c9cbc432f1724eaea323b101cf10d8b607355ad2f44b4331be8a47611f8fd836 I0302 15:32:10.164618 30278 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:10.164682 30278 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:10.164697 30278 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 31562 or (T in {31562})}] I0302 15:32:10.196068 30278 tablet.cc:1059] Compaction successful on 172639 rows (4354122 bytes) I0302 15:32:10.200439 30278 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.441s user 0.150s sys 0.034s I0302 15:32:10.222555 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 59.6248ms) I0302 15:32:10.241636 30226 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be5f2a9830549a443fbbe67e94deab64f2 I0302 15:32:10.241696 30226 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:10.241756 30226 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:10.241773 30226 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 30851 or (T in {30851})}] I0302 15:32:10.266155 30226 tablet.cc:1059] Compaction successful on 172639 rows (4354122 bytes) I0302 15:32:10.269436 30226 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.346s user 0.137s sys 0.029s I0302 15:32:10.290961 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/masterz I0302 15:32:10.299700 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:10.375771 30180 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8deabfe2e8043a3e49a5bb4fd5e787b86c2b I0302 15:32:10.375857 30180 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:10.375952 30180 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:10.375996 30180 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 31921 or (T in {31921})}] I0302 15:32:10.391392 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 56.3025ms) I0302 15:32:10.406633 30180 tablet.cc:1059] Compaction successful on 172464 rows (4349922 bytes) I0302 15:32:10.410663 30180 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.303s user 0.134s sys 0.027s I0302 15:32:10.423346 30226 tablet.cc:1081] Compaction: stage 1 complete, picked 2 rowsets to compact I0302 15:32:10.423368 30226 compaction.cc:552] Selected 2 rowsets to compact: I0302 15:32:10.423379 30226 compaction.cc:555] RowSet(15)(current size on disk: ~3879625 bytes) I0302 15:32:10.423391 30226 compaction.cc:555] RowSet(16)(current size on disk: ~260645 bytes) I0302 15:32:10.423405 30226 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 31104 or (T in {31104})}] I0302 15:32:10.423753 30226 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:10.423946 30226 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:10.424124 30226 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:10.424301 30226 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:10.460454 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:10.576509 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 76.2235ms) I0302 15:32:10.608232 30180 tablet.cc:1081] Compaction: stage 1 complete, picked 2 rowsets to compact I0302 15:32:10.608261 30180 compaction.cc:552] Selected 2 rowsets to compact: I0302 15:32:10.608279 30180 compaction.cc:555] RowSet(16)(current size on disk: ~3882169 bytes) I0302 15:32:10.608294 30180 compaction.cc:555] RowSet(17)(current size on disk: ~262301 bytes) I0302 15:32:10.608314 30180 tablet.cc:878] Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 31581 or (T in {31581})}] I0302 15:32:10.608813 30180 multi_column_writer.cc:71] Opened CFile writer for column rand_key[uint64 NOT NULL] I0302 15:32:10.609107 30180 multi_column_writer.cc:71] Opened CFile writer for column link_to[uint64 NOT NULL] I0302 15:32:10.609345 30180 multi_column_writer.cc:71] Opened CFile writer for column insert_ts[uint64 NOT NULL] I0302 15:32:10.609575 30180 multi_column_writer.cc:71] Opened CFile writer for column updated[bool NOT NULL] I0302 15:32:10.631906 30226 delta_tracker.cc:69] Successfully opened UNDO delta file 8742962816284c9e8fad0726169d72be07dd9b0862794ab5b7e6bff406156731 I0302 15:32:10.631978 30226 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:10.632375 30226 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:10.632411 30226 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 31104 or (T in {31104})}] I0302 15:32:10.637109 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:10.652253 30226 tablet.cc:1059] Compaction successful on 172464 rows (4349922 bytes) I0302 15:32:10.655822 30226 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(ad1251b8988446ffa0348b542d353bd4): real 0.232s user 0.110s sys 0.028s I0302 15:32:10.762333 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 85.1006ms) I0302 15:32:10.826876 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:10.870760 30180 delta_tracker.cc:69] Successfully opened UNDO delta file cb8ec8ace5794df5bd0c9c859c1b8dead9cbd7d49bcd4a8699636ec0ce505288 I0302 15:32:10.870820 30180 tablet.cc:964] Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0302 15:32:10.870877 30180 tablet.cc:1026] Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0302 15:32:10.870893 30180 tablet.cc:1027] Phase 2 snapshot: MvccSnapshot[committed={T|T < 31581 or (T in {31581})}] I0302 15:32:10.895212 30180 tablet.cc:1059] Compaction successful on 172639 rows (4354122 bytes) I0302 15:32:10.899590 30180 maintenance_manager.cc:316] Time spent running CompactRowSetsOp(4129cb7b8c2b4cdcbcdee9f8ecb69ae7): real 0.291s user 0.142s sys 0.026s I0302 15:32:10.931097 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 70.9191ms) I0302 15:32:10.979549 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:11.071341 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 56.9443ms) I0302 15:32:11.116634 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:11.207578 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 55.8699ms) I0302 15:32:11.252756 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:11.291121 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/tablez I0302 15:32:11.345912 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 58.2695ms) I0302 15:32:11.404739 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:11.494089 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 55.9519ms) I0302 15:32:11.543225 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:11.626956 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 48.1035ms) I0302 15:32:11.685811 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:11.766862 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 47.7332ms) I0302 15:32:11.809844 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:11.896612 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 50.6676ms) I0302 15:32:11.941274 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:12.030290 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 51.9218ms) I0302 15:32:12.074481 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:12.157321 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 49.8616ms) I0302 15:32:12.200630 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:12.282006 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 47.9778ms) I0302 15:32:12.291286 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/tablet-servers I0302 15:32:12.340469 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:12.417770 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 44.4098ms) I0302 15:32:12.460619 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:12.539212 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 45.0017ms) I0302 15:32:12.597674 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:12.675880 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 45.2201ms) I0302 15:32:12.733758 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:12.816557 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 49.9157ms) I0302 15:32:12.880115 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:12.957912 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 44.5655ms) I0302 15:32:13.001354 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:13.096513 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 56.3898ms) I0302 15:32:13.142696 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:13.229678 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 52.9893ms) I0302 15:32:13.277714 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:13.291440 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:40132/jsonmetricz I0302 15:32:13.372401 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 58.274ms) I0302 15:32:13.434165 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:13.545009 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 70.6556ms) I0302 15:32:13.602309 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:13.707821 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 67.1682ms) I0302 15:32:13.759157 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:13.863281 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 68.7341ms) I0302 15:32:13.912899 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:14.013902 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 65.5893ms) I0302 15:32:14.087478 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:14.201756 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 74.5984ms) I0302 15:32:14.271044 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:14.291620 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:40132/tablets I0302 15:32:14.376364 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 66.8494ms) I0302 15:32:14.444645 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:14.523349 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 45.3094ms) I0302 15:32:14.584097 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:14.667654 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 49.388ms) I0302 15:32:14.713181 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:14.794328 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 47.8789ms) I0302 15:32:14.840622 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:14.920676 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 46.2163ms) I0302 15:32:14.980728 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:15.078898 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 63.9601ms) I0302 15:32:15.132195 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:15.212636 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 47.0255ms) I0302 15:32:15.270624 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:15.292230 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:55689/jsonmetricz I0302 15:32:15.356053 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 51.2233ms) I0302 15:32:15.417383 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:15.502138 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 49.8255ms) I0302 15:32:15.546362 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:15.650742 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 68.8079ms) I0302 15:32:15.721087 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:15.821037 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 62.282ms) I0302 15:32:15.868844 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:15.949146 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 46.5128ms) I0302 15:32:15.993968 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:16.073302 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 46.4894ms) I0302 15:32:16.119429 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:16.214449 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 54.4604ms) I0302 15:32:16.276304 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:16.292384 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:55689/tablets I0302 15:32:16.378242 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 68.4627ms) I0302 15:32:16.448403 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:16.543540 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 61.9021ms) I0302 15:32:16.608872 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:16.711295 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 61.5572ms) I0302 15:32:16.770820 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:16.857663 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 49.3618ms) I0302 15:32:16.916081 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:16.996991 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 46.7726ms) I0302 15:32:17.039979 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:17.126049 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 52.8682ms) I0302 15:32:17.185771 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:17.276760 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 57.4562ms) I0302 15:32:17.292549 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:43948/jsonmetricz I0302 15:32:17.337061 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:17.435708 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 61.5897ms) I0302 15:32:17.507061 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:17.610350 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 64.5144ms) I0302 15:32:17.664990 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:17.769418 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 66.2333ms) I0302 15:32:17.825718 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:17.923610 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 63.1735ms) I0302 15:32:17.993428 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:18.102637 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 70.8856ms) I0302 15:32:18.180918 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:18.292640 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:43948/tablets I0302 15:32:18.295897 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 72.4705ms) I0302 15:32:18.360648 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:18.472270 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 72.053ms) I0302 15:32:18.544910 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:18.643206 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 63.6028ms) I0302 15:32:18.711585 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:18.807396 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 60.3597ms) I0302 15:32:18.866395 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:18.955124 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 52.3923ms) I0302 15:32:19.003638 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:19.099527 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 61.0721ms) I0302 15:32:19.151072 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:19.245152 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 57.1265ms) I0302 15:32:19.292798 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/jsonmetricz I0302 15:32:19.303191 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:19.386240 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 50.015ms) I0302 15:32:19.429225 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:19.514626 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 47.6437ms) I0302 15:32:19.575322 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:19.659077 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 49.1163ms) I0302 15:32:19.703608 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:19.789762 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 50.7829ms) I0302 15:32:19.847594 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:19.925436 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 44.6035ms) I0302 15:32:19.968428 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:20.051283 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 44.6618ms) I0302 15:32:20.093930 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:20.171654 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 45.0139ms) I0302 15:32:20.229761 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:20.292951 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/masterz I0302 15:32:20.313037 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 46.2138ms) I0302 15:32:20.356864 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:20.448076 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 55.2085ms) I0302 15:32:20.503031 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:20.589432 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 53.3237ms) I0302 15:32:20.657853 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:20.742202 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 49.8955ms) I0302 15:32:20.804240 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:20.893893 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 55.7483ms) I0302 15:32:20.938671 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:21.027999 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 54.1847ms) I0302 15:32:21.073611 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:21.164816 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 51.3425ms) I0302 15:32:21.208297 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:21.293122 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/tablez I0302 15:32:21.296108 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 47.6817ms) I0302 15:32:21.340126 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:21.420480 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 47.0899ms) I0302 15:32:21.464577 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:21.553694 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 53.8245ms) I0302 15:32:21.597913 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:21.684608 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 53.0399ms) I0302 15:32:21.744153 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:21.824792 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 47.1646ms) I0302 15:32:21.867835 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:21.955654 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 52.889ms) I0302 15:32:22.014147 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:22.103369 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 56.0305ms) I0302 15:32:22.148396 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:22.243798 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 59.9274ms) I0302 15:32:22.293297 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/tablet-servers I0302 15:32:22.297639 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:22.403911 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 69.0117ms) I0302 15:32:22.454757 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:22.555285 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 62.9809ms) I0302 15:32:22.603562 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:22.710854 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 69.9488ms) I0302 15:32:22.757979 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:22.853580 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 59.1587ms) I0302 15:32:22.916903 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:23.014297 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 60.9051ms) I0302 15:32:23.063246 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:23.173188 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 68.8817ms) I0302 15:32:23.232486 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:23.293459 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:40132/jsonmetricz I0302 15:32:23.333261 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 64.5472ms) I0302 15:32:23.380214 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:23.475467 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 58.9675ms) I0302 15:32:23.522732 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:23.623260 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 61.8381ms) I0302 15:32:23.677835 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:23.789834 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 72.1513ms) I0302 15:32:23.844046 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:23.948642 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 65.5139ms) I0302 15:32:23.999557 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:24.109511 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 70.6734ms) I0302 15:32:24.162181 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:24.266757 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 63.903ms) I0302 15:32:24.293623 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:40132/tablets I0302 15:32:24.320899 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:24.431934 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 71.8807ms) I0302 15:32:24.507488 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:24.615741 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 68.7858ms) I0302 15:32:24.683230 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:24.774858 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 56.9002ms) I0302 15:32:24.835865 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:24.913528 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 44.4936ms) I0302 15:32:24.958045 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:25.045943 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 52.7915ms) I0302 15:32:25.092175 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:25.178378 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 51.2385ms) I0302 15:32:25.224704 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:25.293797 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:55689/jsonmetricz I0302 15:32:25.320042 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 59.4645ms) I0302 15:32:25.383329 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:25.485044 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 66.4453ms) I0302 15:32:25.531760 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:25.619415 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 51.0004ms) I0302 15:32:25.671360 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:25.768020 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 55.8578ms) I0302 15:32:25.812759 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:25.900068 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 49.6327ms) I0302 15:32:25.960669 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:26.041115 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 46.9686ms) I0302 15:32:26.099289 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:26.187489 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 54.9835ms) I0302 15:32:26.255097 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:26.293964 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:55689/tablets I0302 15:32:26.347918 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 59.5266ms) I0302 15:32:26.398533 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:26.481690 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 47.4657ms) I0302 15:32:26.541653 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:26.623471 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 48.6155ms) I0302 15:32:26.668743 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:26.746495 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 45.0843ms) I0302 15:32:26.790899 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:26.870455 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 46.4997ms) I0302 15:32:26.914796 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:26.995064 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 47.1722ms) I0302 15:32:27.055089 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:27.134892 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 46.5993ms) I0302 15:32:27.178077 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:27.257053 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 45.9204ms) I0302 15:32:27.294123 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:43948/jsonmetricz I0302 15:32:27.300097 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:27.378180 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 44.5586ms) I0302 15:32:27.421450 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:27.517118 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 61.0328ms) I0302 15:32:27.569977 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:27.661110 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 54.9143ms) I0302 15:32:27.705546 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:27.796056 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 57.0649ms) I0302 15:32:27.870802 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:27.966044 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 58.3473ms) I0302 15:32:28.016666 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:28.113881 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 61.1744ms) I0302 15:32:28.181126 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:28.283166 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 65.3717ms) I0302 15:32:28.294286 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:43948/tablets I0302 15:32:28.339710 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:28.441685 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 58.9857ms) I0302 15:32:28.489184 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:28.600041 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 71.4546ms) I0302 15:32:28.669839 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:28.763804 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 57.1011ms) I0302 15:32:28.834341 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:28.935698 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 62.5501ms) I0302 15:32:29.005048 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:29.117972 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 75.3625ms) I0302 15:32:29.173809 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:29.273548 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 57.769ms) I0302 15:32:29.294469 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/jsonmetricz I0302 15:32:29.321671 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:29.412467 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 56.352ms) I0302 15:32:29.459656 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:29.570214 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 73.5497ms) I0302 15:32:29.624197 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:29.727480 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 63.6128ms) I0302 15:32:29.780125 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:29.870064 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 55.8429ms) I0302 15:32:29.923398 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:30.016000 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 56.6226ms) I0302 15:32:30.080544 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:30.173935 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 56.9534ms) I0302 15:32:30.227040 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:30.294646 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/masterz I0302 15:32:30.328472 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 63.7091ms) I0302 15:32:30.397223 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:30.501791 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 66.9243ms) I0302 15:32:30.576650 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:30.658890 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 43.8617ms) I0302 15:32:30.701762 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:30.790251 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 53.93ms) I0302 15:32:30.839033 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:30.926396 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 54.1079ms) I0302 15:32:30.974663 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:31.064529 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 56.5526ms) I0302 15:32:31.115671 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:31.215919 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 59.7916ms) I0302 15:32:31.266191 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:31.294806 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/tablez I0302 15:32:31.354156 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 52.4373ms) I0302 15:32:31.412266 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:31.498565 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 51.4912ms) I0302 15:32:31.554287 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:31.669589 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 74.7931ms) I0302 15:32:31.721485 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:31.806475 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 51.069ms) I0302 15:32:31.853303 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:31.940708 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 50.635ms) I0302 15:32:32.008420 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:32.092667 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 51.1735ms) I0302 15:32:32.136880 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:32.219290 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 49.1956ms) I0302 15:32:32.262759 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:32.294963 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:41309/tablet-servers I0302 15:32:32.348261 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 52.2925ms) I0302 15:32:32.412149 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:32.500120 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 48.5558ms) I0302 15:32:32.548411 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:32.632454 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 50.8613ms) I0302 15:32:32.698238 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:32.793162 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 56.6708ms) I0302 15:32:32.841213 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:32.924888 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 50.2157ms) I0302 15:32:32.975239 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:33.058322 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 49.9929ms) I0302 15:32:33.102401 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:33.184406 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 48.109ms) I0302 15:32:33.227426 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:33.295137 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:40132/jsonmetricz I0302 15:32:33.305769 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 45.4233ms) I0302 15:32:33.352517 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:33.451262 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 55.5852ms) I0302 15:32:33.513802 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:33.607952 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 61.2395ms) I0302 15:32:33.655887 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:33.744855 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 55.4919ms) I0302 15:32:33.816090 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:33.920641 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 62.4125ms) I0302 15:32:33.969604 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:34.055937 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 52.5714ms) I0302 15:32:34.114361 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:34.218044 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 68.6066ms) I0302 15:32:34.291200 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:34.295305 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:40132/tablets I0302 15:32:34.388741 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 61.1133ms) I0302 15:32:34.448954 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:34.547868 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 65.2228ms) I0302 15:32:34.613488 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:34.730099 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 73.2325ms) I0302 15:32:34.781769 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:34.878875 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 60.7751ms) I0302 15:32:34.960120 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:35.073570 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 73.079ms) I0302 15:32:35.149984 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:35.251065 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 62.8762ms) I0302 15:32:35.295469 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:55689/jsonmetricz I0302 15:32:35.324162 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:35.435385 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 64.2945ms) I0302 15:32:35.503479 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:35.604799 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 61.8076ms) I0302 15:32:35.659159 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:35.769963 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 71.3849ms) I0302 15:32:35.836984 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:35.921053 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 50.5045ms) I0302 15:32:35.970273 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:36.068881 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 64.927ms) I0302 15:32:36.137657 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:36.241004 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 65.7839ms) I0302 15:32:36.291069 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:36.295650 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:55689/tablets I0302 15:32:36.401006 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 72.4166ms) I0302 15:32:36.468652 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:36.583881 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 72.9346ms) I0302 15:32:36.653195 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:36.739514 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 52.1915ms) I0302 15:32:36.786314 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:36.889608 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 65.0178ms) I0302 15:32:36.940310 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:37.033607 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 56.4624ms) I0302 15:32:37.081675 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:37.181421 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 59.5381ms) I0302 15:32:37.246708 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:37.295800 28547 linked_list-test-util.h:284] Curling URL http://127.0.0.1:43948/jsonmetricz I0302 15:32:37.340011 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 58.1211ms) I0302 15:32:37.390836 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:37.489334 28280 linked_list-test-util.h:656] Done collecting results (504923 rows in 61.3927ms) I0302 15:32:37.547781 28280 linked_list-test-util.h:571] Table not yet ready: 504923/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:37.645995 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 65.4728ms) I0302 15:32:37.699169 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:37.801828 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 63.5686ms) I0302 15:32:37.851457 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:37.943500 28280 linked_list-test-util.h:656] Done collecting results (503777 rows in 54.0285ms) I0302 15:32:38.006428 28280 linked_list-test-util.h:571] Table not yet ready: 503777/517150 rows (status: Corruption: Had one or more errors during verification (see log)) I0302 15:32:38.090287 28280 linked_list-test-util.h:656] Done collecting results (504074 rows in 49.0772ms) E0302 15:32:38.154820 28280 linked_list-test-util.h:638] Entry 1175807734720560 was linked to but not present E0302 15:32:38.154875 28280 linked_list-test-util.h:638] Entry 1310734661039107 was linked to but not present E0302 15:32:38.154899 28280 linked_list-test-util.h:638] Entry 1828490700764183 was linked to but not present E0302 15:32:38.154923 28280 linked_list-test-util.h:638] Entry 2559819115255335 was linked to but not present E0302 15:32:38.154947 28280 linked_list-test-util.h:638] Entry 2622568833705990 was linked to but not present E0302 15:32:38.154970 28280 linked_list-test-util.h:638] Entry 2773077961207333 was linked to but not present E0302 15:32:38.155004 28280 linked_list-test-util.h:638] Entry 3658080913156142 was linked to but not present E0302 15:32:38.155027 28280 linked_list-test-util.h:638] Entry 3934403006372873 was linked to but not present E0302 15:32:38.155050 28280 linked_list-test-util.h:638] Entry 4843397739151398 was linked to but not present E0302 15:32:38.155072 28280 linked_list-test-util.h:638] Entry 6055506678233117 was linked to but not present E0302 15:32:38.155096 28280 linked_list-test-util.h:638] Entry 6626941428907778 was linked to but not present E0302 15:32:38.155118 28280 linked_list-test-util.h:638] Entry 6899879076735515 was linked to but not present E0302 15:32:38.155140 28280 linked_list-test-util.h:638] Entry 7303087890063912 was linked to but not present E0302 15:32:38.155164 28280 linked_list-test-util.h:638] Entry 7310028584643109 was linked to but not present E0302 15:32:38.155187 28280 linked_list-test-util.h:638] Entry 7934124136497152 was linked to but not present E0302 15:32:38.155211 28280 linked_list-test-util.h:638] Entry 9329706202289189 was linked to but not present E0302 15:32:38.155235 28280 linked_list-test-util.h:638] Entry 9573833100451598 was linked to but not present E0302 15:32:38.155256 28280 linked_list-test-util.h:638] Entry 9902708622850321 was linked to but not present E0302 15:32:38.155279 28280 linked_list-test-util.h:638] Entry 10289295846523661 was linked to but not present E0302 15:32:38.155303 28280 linked_list-test-util.h:638] Entry 10439280988350732 was linked to but not present E0302 15:32:38.155325 28280 linked_list-test-util.h:638] Entry 10598401556575264 was linked to but not present E0302 15:32:38.155347 28280 linked_list-test-util.h:638] Entry 11074406056826664 was linked to but not present E0302 15:32:38.155370 28280 linked_list-test-util.h:638] Entry 12210167359838211 was linked to but not present E0302 15:32:38.155393 28280 linked_list-test-util.h:638] Entry 12543290620859436 was linked to but not present E0302 15:32:38.155416 28280 linked_list-test-util.h:638] Entry 13040619711820553 was linked to but not present E0302 15:32:38.155438 28280 linked_list-test-util.h:638] Entry 13919961876099858 was linked to but not present E0302 15:32:38.155460 28280 linked_list-test-util.h:638] Entry 13990253585223727 was linked to but not present E0302 15:32:38.155483 28280 linked_list-test-util.h:638] Entry 14438980639772938 was linked to but not present E0302 15:32:38.155505 28280 linked_list-test-util.h:638] Entry 15895976685388302 was linked to but not present E0302 15:32:38.155529 28280 linked_list-test-util.h:638] Entry 16055522458769937 was linked to but not present E0302 15:32:38.155551 28280 linked_list-test-util.h:638] Entry 16307230004966664 was linked to but not present E0302 15:32:38.155575 28280 linked_list-test-util.h:638] Entry 19148215956717340 was linked to but not present E0302 15:32:38.155596 28280 linked_list-test-util.h:638] Entry 19157278372737537 was linked to but not present E0302 15:32:38.155619 28280 linked_list-test-util.h:638] Entry 19177864233778733 was linked to but not present E0302 15:32:38.155642 28280 linked_list-test-util.h:638] Entry 19256063006972163 was linked to but not present E0302 15:32:38.155664 28280 linked_list-test-util.h:638] Entry 19406499124096811 was linked to but not present E0302 15:32:38.155686 28280 linked_list-test-util.h:638] Entry 19473561004368395 was linked to but not present E0302 15:32:38.155709 28280 linked_list-test-util.h:638] Entry 20889733226941969 was linked to but not present E0302 15:32:38.155731 28280 linked_list-test-util.h:638] Entry 21512106488069654 was linked to but not present E0302 15:32:38.155755 28280 linked_list-test-util.h:638] Entry 23547413555740441 was linked to but not present E0302 15:32:38.155776 28280 linked_list-test-util.h:638] Entry 23844514783896341 was linked to but not present E0302 15:32:38.155799 28280 linked_list-test-util.h:638] Entry 24366647412943409 was linked to but not present E0302 15:32:38.155822 28280 linked_list-test-util.h:638] Entry 24421434231304198 was linked to but not present E0302 15:32:38.155844 28280 linked_list-test-util.h:638] Entry 25593582636274944 was linked to but not present E0302 15:32:38.155866 28280 linked_list-test-util.h:638] Entry 27205309782176771 was linked to but not present E0302 15:32:38.155889 28280 linked_list-test-util.h:638] Entry 27708802180687390 was linked to but not present E0302 15:32:38.155912 28280 linked_list-test-util.h:638] Entry 27730139658618376 was linked to but not present E0302 15:32:38.155935 28280 linked_list-test-util.h:638] Entry 27841023263827492 was linked to but not present E0302 15:32:38.155957 28280 linked_list-test-util.h:638] Entry 27942144367800612 was linked to but not present E0302 15:32:38.155987 28280 linked_list-test-util.h:638] Entry 28611960026254338 was linked to but not present E0302 15:32:38.156011 28280 linked_list-test-util.h:638] Entry 28879060791173652 was linked to but not present E0302 15:32:38.157163 28280 linked_list-test-util.h:638] Entry 29149284012947728 was linked to but not present E0302 15:32:38.157191 28280 linked_list-test-util.h:638] Entry 29436309211053610 was linked to but not present E0302 15:32:38.157214 28280 linked_list-test-util.h:638] Entry 30189520572154661 was linked to but not present E0302 15:32:38.157238 28280 linked_list-test-util.h:638] Entry 30246669630393883 was linked to but not present E0302 15:32:38.157259 28280 linked_list-test-util.h:638] Entry 31410090626860564 was linked to but not present E0302 15:32:38.157282 28280 linked_list-test-util.h:638] Entry 32267609976290593 was linked to but not present E0302 15:32:38.157307 28280 linked_list-test-util.h:638] Entry 32814370039578909 was linked to but not present E0302 15:32:38.157330 28280 linked_list-test-util.h:638] Entry 32960124621443118 was linked to but not present E0302 15:32:38.157351 28280 linked_list-test-util.h:638] Entry 33568242832837164 was linked to but not present E0302 15:32:38.157374 28280 linked_list-test-util.h:638] Entry 33648872564847898 was linked to but not present E0302 15:32:38.157397 28280 linked_list-test-util.h:638] Entry 34047807869413922 was linked to but not present E0302 15:32:38.157419 28280 linked_list-test-util.h:638] Entry 34125650164994337 was linked to but not present E0302 15:32:38.157441 28280 linked_list-test-util.h:638] Entry 36632701102770185 was linked to but not present E0302 15:32:38.157464 28280 linked_list-test-util.h:638] Entry 37390490918572033 was linked to but not present E0302 15:32:38.157485 28280 linked_list-test-util.h:638] Entry 38186398718540289 was linked to but not present E0302 15:32:38.157508 28280 linked_list-test-util.h:638] Entry 39125522760952364 was linked to but not present E0302 15:32:38.157531 28280 linked_list-test-util.h:638] Entry 39162644309747991 was linked to but not present E0302 15:32:38.157552 28280 linked_list-test-util.h:638] Entry 39560518751442196 was linked to but not present E0302 15:32:38.157574 28280 linked_list-test-util.h:638] Entry 39739941713471011 was linked to but not present E0302 15:32:38.157598 28280 linked_list-test-util.h:638] Entry 41498123517847074 was linked to but not present E0302 15:32:38.157620 28280 linked_list-test-util.h:638] Entry 43541161558651183 was linked to but not present E0302 15:32:38.157642 28280 linked_list-test-util.h:638] Entry 44357861376477188 was linked to but not present E0302 15:32:38.157665 28280 linked_list-test-util.h:638] Entry 45571890171621167 was linked to but not present E0302 15:32:38.157687 28280 linked_list-test-util.h:638] Entry 45624447892240927 was linked to but not present E0302 15:32:38.157709 28280 linked_list-test-util.h:638] Entry 47411466220724741 was linked to but not present E0302 15:32:38.157732 28280 linked_list-test-util.h:638] Entry 48843967974236172 was linked to but not present E0302 15:32:38.157754 28280 linked_list-test-util.h:638] Entry 50123525345688583 was linked to but not present E0302 15:32:38.157776 28280 linked_list-test-util.h:638] Entry 50452512535825179 was linked to but not present E0302 15:32:38.157799 28280 linked_list-test-util.h:638] Entry 51002407943189535 was linked to but not present E0302 15:32:38.157820 28280 linked_list-test-util.h:638] Entry 51014408125042199 was linked to but not present E0302 15:32:38.157842 28280 linked_list-test-util.h:638] Entry 51028572985740081 was linked to but not present E0302 15:32:38.157866 28280 linked_list-test-util.h:638] Entry 51062649388100626 was linked to but not present E0302 15:32:38.157887 28280 linked_list-test-util.h:638] Entry 51265969641880341 was linked to but not present E0302 15:32:38.157909 28280 linked_list-test-util.h:638] Entry 51715572872581633 was linked to but not present E0302 15:32:38.157932 28280 linked_list-test-util.h:638] Entry 52012549550081048 was linked to but not present E0302 15:32:38.157955 28280 linked_list-test-util.h:638] Entry 53845584339622705 was linked to but not present E0302 15:32:38.157989 28280 linked_list-test-util.h:638] Entry 54204988606672659 was linked to but not present E0302 15:32:38.158011 28280 linked_list-test-util.h:638] Entry 54241221096397581 was linked to but not present E0302 15:32:38.158035 28280 linked_list-test-util.h:638] Entry 57767639265102857 was linked to but not present E0302 15:32:38.158057 28280 linked_list-test-util.h:638] Entry 58421782524732961 was linked to but not present E0302 15:32:38.158079 28280 linked_list-test-util.h:638] Entry 58742519056105498 was linked to but not present E0302 15:32:38.158102 28280 linked_list-test-util.h:638] Entry 59040492164673039 was linked to but not present E0302 15:32:38.158124 28280 linked_list-test-util.h:638] Entry 60396362810574863 was linked to but not present E0302 15:32:38.158146 28280 linked_list-test-util.h:638] Entry 60513912234607618 was linked to but not present E0302 15:32:38.158169 28280 linked_list-test-util.h:638] Entry 60997716422628627 was linked to but not present E0302 15:32:38.158190 28280 linked_list-test-util.h:638] Entry 61253117651590693 was linked to but not present E0302 15:32:38.158212 28280 linked_list-test-util.h:638] Entry 61328954184905744 was linked to but not present E0302 15:32:38.158236 28280 linked_list-test-util.h:638] Entry 62591198472968221 was linked to but not present E0302 15:32:38.158257 28280 linked_list-test-util.h:638] Entry 63315895434559014 was linked to but not present E0302 15:32:38.158279 28280 linked_list-test-util.h:641] ... no more broken links will be logged E0302 15:32:38.158334 28280 linked_list-test-util.h:649] Error count for tablet #0: 8738 E0302 15:32:38.158357 28280 linked_list-test-util.h:649] Error count for tablet #1: 0 E0302 15:32:38.158380 28280 linked_list-test-util.h:649] Error count for tablet #2: 0 E0302 15:32:38.159435 28280 linked_list-test-util.h:678] Had 8788 entries which were seen but not linked to. Expected only 50 I0302 15:32:38.159587 28280 linked_list-test-util.h:571] Table not yet ready: 504074/517150 rows (status: Corruption: Had one or more errors during verification (see log)) /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/src/kudu/integration-tests/linked_list-test.cc:191: Failure Failed Bad status: Timed out: Timed out waiting for table to be accessible again: Corruption: Had one or more errors during verification (see log) I0302 15:32:38.159807 28280 linked_list-test-util.h:266] Shutting down curl thread I0302 15:32:38.296241 28280 external_mini_cluster.cc:446] Killing /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-master with pid 28287 I0302 15:32:38.302187 28280 external_mini_cluster.cc:446] Killing /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server with pid 30179 I0302 15:32:38.318239 28280 external_mini_cluster.cc:446] Killing /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server with pid 30225 I0302 15:32:38.333044 28280 external_mini_cluster.cc:446] Killing /data1/jenkins-workspace/kudu-gerrit/BUILD_TYPE/LEAKCHECK/label/kudu-gerrit-slaves/build/release/kudu-tablet_server with pid 30275 I0302 15:32:38.346711 28280 test_util.cc:55] ----------------------------------------------- I0302 15:32:38.346751 28280 test_util.cc:56] Had fatal failures, leaving test files at /data1/test-tmp/linked_list-test.LinkedListTest.TestLoadAndVerify.1425339087178522-28280 [ FAILED ] LinkedListTest.TestLoadAndVerify (71168 ms) [----------] 1 test from LinkedListTest (71168 ms total) [----------] Global test environment tear-down [==========] 1 test from 1 test case ran. (71168 ms total) [ PASSED ] 0 tests. [ FAILED ] 1 test, listed below: [ FAILED ] LinkedListTest.TestLoadAndVerify 1 FAILED TEST Have memory regions w/o callers: might report false leaks No leaks found for check "_main_" (but no 100% guarantee that there aren't any): found 7937 reachable heap objects of 360510 bytes