I1031 23:03:52.449676 32814 tablet_service.cc:650] Processing CreateTablet for tablet 68aa6071fa594e79958cddb8489a1f0c (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 0, RANGE (date) PARTITION 20171025 <= VALUES < 20171026 I1031 23:03:52.449687 32801 tablet_service.cc:650] Processing CreateTablet for tablet f49a4f915ac048b096fcb5f4878f436d (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 0, RANGE (date) PARTITION 20171029 <= VALUES < 20171030 I1031 23:03:52.449681 32802 tablet_service.cc:650] Processing CreateTablet for tablet 5110f0095bd94f67abf0aad906332efe (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 0, RANGE (date) PARTITION 20171028 <= VALUES < 20171029 I1031 23:03:52.449687 32818 tablet_service.cc:650] Processing CreateTablet for tablet 6f911a94e20d47aa9efaf9ffe3914c3b (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 0, RANGE (date) PARTITION 20171101 <= VALUES < 20171102 I1031 23:03:52.449709 32810 tablet_service.cc:650] Processing CreateTablet for tablet 31d6227f03a240c0977a072c02773b7a (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 1, RANGE (date) PARTITION 20171025 <= VALUES < 20171026 I1031 23:03:52.449761 32817 tablet_service.cc:650] Processing CreateTablet for tablet cc323d8862bb429490b7ef96568245c5 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 1, RANGE (date) PARTITION 20171028 <= VALUES < 20171029 I1031 23:03:52.449769 32815 tablet_service.cc:650] Processing CreateTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 1, RANGE (date) PARTITION 20171030 <= VALUES < 20171031 I1031 23:03:52.449771 32806 tablet_service.cc:650] Processing CreateTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 1, RANGE (date) PARTITION 20171027 <= VALUES < 20171028 I1031 23:03:52.450664 32803 tablet_service.cc:650] Processing CreateTablet for tablet c1be6b6a217c475b9aed375afd1f491b (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 2, RANGE (date) PARTITION 20171023 <= VALUES < 20171024 I1031 23:03:52.450693 32819 tablet_service.cc:650] Processing CreateTablet for tablet 9967925d5dbd49eaadc0a1a58e7e2089 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 2, RANGE (date) PARTITION 20171028 <= VALUES < 20171029 I1031 23:03:52.450706 32813 tablet_service.cc:650] Processing CreateTablet for tablet 6ca74226a6af40e2a78046fc3591c038 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 2, RANGE (date) PARTITION 20171024 <= VALUES < 20171025 I1031 23:03:52.450721 32816 tablet_service.cc:650] Processing CreateTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 3, RANGE (date) PARTITION 20171023 <= VALUES < 20171024 I1031 23:03:52.450753 32811 tablet_service.cc:650] Processing CreateTablet for tablet e53178c96c3c4ad2b3068e9674d1259d (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 3, RANGE (date) PARTITION 20171025 <= VALUES < 20171026 I1031 23:03:52.450762 32805 tablet_service.cc:650] Processing CreateTablet for tablet fcde65c4e4cf4df29b9ef9884ce292b2 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 2, RANGE (date) PARTITION 20171031 <= VALUES < 20171101 I1031 23:03:52.451371 32800 tablet_service.cc:650] Processing CreateTablet for tablet de45d05c3a064dc5acb91d66dcaea6ed (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 3, RANGE (date) PARTITION 20171029 <= VALUES < 20171030 I1031 23:03:52.451372 32804 tablet_service.cc:650] Processing CreateTablet for tablet 090accc17fae4e60b7bddb6dd0bf2ef8 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 3, RANGE (date) PARTITION 20171030 <= VALUES < 20171031 I1031 23:03:52.451392 32807 tablet_service.cc:650] Processing CreateTablet for tablet 13f1cd14968447f7951d92ce30c4b7c0 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 4, RANGE (date) PARTITION 20171026 <= VALUES < 20171027 I1031 23:03:52.451436 32809 tablet_service.cc:650] Processing CreateTablet for tablet 42d56cd12bbb4bed9973f96a230fdb9e (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 4, RANGE (date) PARTITION 20171030 <= VALUES < 20171031 I1031 23:03:52.734959 32800 ts_tablet_manager.cc:862] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:52.735221 27533 ts_tablet_manager.cc:723] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:03:52.735635 27533 tablet_bootstrap.cc:382] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:03:52.735798 27533 tablet_bootstrap.cc:541] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:03:52.735908 27533 tablet_bootstrap.cc:484] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:03:52.736621 27533 tablet_bootstrap.cc:382] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:03:52.736654 27533 ts_tablet_manager.cc:728] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s I1031 23:03:52.737205 27533 raft_consensus.cc:288] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "0f53a0d3ef7e44ebb0365c800752d5bd" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st01.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:03:52.737226 27533 raft_consensus.cc:319] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:03:52.737237 27533 raft_consensus.cc:548] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:03:52.737253 27533 consensus_queue.cc:176] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:03:52.760095 32816 ts_tablet_manager.cc:862] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:52.760535 27538 ts_tablet_manager.cc:723] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:03:52.760841 27538 tablet_bootstrap.cc:382] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:03:52.760996 27538 tablet_bootstrap.cc:541] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:03:52.761104 27538 tablet_bootstrap.cc:484] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:03:52.776211 27538 tablet_bootstrap.cc:382] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:03:52.776239 27538 ts_tablet_manager.cc:728] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s I1031 23:03:52.776743 27538 raft_consensus.cc:288] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:03:52.776762 27538 raft_consensus.cc:319] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:03:52.776772 27538 raft_consensus.cc:548] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:03:52.776787 27538 consensus_queue.cc:176] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:03:52.785368 32819 ts_tablet_manager.cc:862] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:52.785728 27543 ts_tablet_manager.cc:723] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:03:52.786149 27543 tablet_bootstrap.cc:382] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:03:52.786288 27543 tablet_bootstrap.cc:541] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:03:52.786391 27543 tablet_bootstrap.cc:484] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:03:52.786876 27543 tablet_bootstrap.cc:382] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:03:52.786911 27543 ts_tablet_manager.cc:728] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s I1031 23:03:52.787588 27543 raft_consensus.cc:288] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } I1031 23:03:52.787607 27543 raft_consensus.cc:319] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:03:52.787616 27543 raft_consensus.cc:548] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:03:52.787628 27543 consensus_queue.cc:176] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:03:52.810550 32813 ts_tablet_manager.cc:862] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:52.810878 27548 ts_tablet_manager.cc:723] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:03:52.811213 27548 tablet_bootstrap.cc:382] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:03:52.811347 27548 tablet_bootstrap.cc:541] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:03:52.811452 27548 tablet_bootstrap.cc:484] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:03:52.812489 27548 tablet_bootstrap.cc:382] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:03:52.812528 27548 ts_tablet_manager.cc:728] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I1031 23:03:52.813185 27548 raft_consensus.cc:288] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:03:52.813205 27548 raft_consensus.cc:319] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:03:52.813213 27548 raft_consensus.cc:548] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:03:52.813226 27548 consensus_queue.cc:176] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:03:52.835835 32818 ts_tablet_manager.cc:862] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:52.836185 27553 ts_tablet_manager.cc:723] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:03:52.836563 27553 tablet_bootstrap.cc:382] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:03:52.836683 27553 tablet_bootstrap.cc:541] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:03:52.836781 27553 tablet_bootstrap.cc:484] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:03:52.837704 27553 tablet_bootstrap.cc:382] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:03:52.837728 27553 ts_tablet_manager.cc:728] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s I1031 23:03:52.838356 27553 raft_consensus.cc:288] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } I1031 23:03:52.838373 27553 raft_consensus.cc:319] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:03:52.838382 27553 raft_consensus.cc:548] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:03:52.838397 27553 consensus_queue.cc:176] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:03:52.861145 32804 ts_tablet_manager.cc:862] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:52.861534 27558 ts_tablet_manager.cc:723] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:03:52.861937 27558 tablet_bootstrap.cc:382] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:03:52.862079 27558 tablet_bootstrap.cc:541] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:03:52.862177 27558 tablet_bootstrap.cc:484] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:03:52.863097 27558 tablet_bootstrap.cc:382] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:03:52.863121 27558 ts_tablet_manager.cc:728] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I1031 23:03:52.863816 27558 raft_consensus.cc:288] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:03:52.863833 27558 raft_consensus.cc:319] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:03:52.863842 27558 raft_consensus.cc:548] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:03:52.863853 27558 consensus_queue.cc:176] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:03:52.886399 32811 ts_tablet_manager.cc:862] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:52.886775 27563 ts_tablet_manager.cc:723] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:03:52.887182 27563 tablet_bootstrap.cc:382] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:03:52.887312 27563 tablet_bootstrap.cc:541] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:03:52.887394 27563 tablet_bootstrap.cc:484] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:03:52.888095 27563 tablet_bootstrap.cc:382] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:03:52.888118 27563 ts_tablet_manager.cc:728] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s I1031 23:03:52.888768 27563 raft_consensus.cc:288] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:03:52.888787 27563 raft_consensus.cc:319] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:03:52.888799 27563 raft_consensus.cc:548] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:03:52.888814 27563 consensus_queue.cc:176] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:03:52.911722 32810 ts_tablet_manager.cc:862] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:52.911905 27568 ts_tablet_manager.cc:723] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:03:52.912282 27568 tablet_bootstrap.cc:382] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:03:52.912420 27568 tablet_bootstrap.cc:541] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:03:52.912513 27568 tablet_bootstrap.cc:484] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:03:52.913120 27568 tablet_bootstrap.cc:382] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:03:52.913144 27568 ts_tablet_manager.cc:728] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s I1031 23:03:52.913635 27568 raft_consensus.cc:288] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:03:52.913653 27568 raft_consensus.cc:319] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:03:52.913663 27568 raft_consensus.cc:548] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:03:52.913676 27568 consensus_queue.cc:176] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:03:52.930795 32828 raft_consensus.cc:2162] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.773s I1031 23:03:52.930817 32828 raft_consensus.cc:1747] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 044f1da9a27c46acb82b1386f829f4dc in term 0. I1031 23:03:52.932297 32828 raft_consensus.cc:2206] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:03:52.932324 32828 raft_consensus.cc:2162] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.184s I1031 23:03:52.932773 32828 raft_consensus.cc:1747] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 044f1da9a27c46acb82b1386f829f4dc in term 1. I1031 23:03:52.937116 32803 ts_tablet_manager.cc:862] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:52.958606 27546 raft_consensus.cc:411] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:03:52.958634 27546 raft_consensus.cc:2162] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.781s I1031 23:03:52.958679 27546 raft_consensus.cc:435] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } I1031 23:03:52.959292 27546 leader_election.cc:216] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:03:52.959344 27546 leader_election.cc:216] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb W1031 23:03:52.959585 32773 leader_election.cc:278] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:03:52.959659 32772 leader_election.cc:348] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Vote granted by peer 193181be29284287b25df2ee92938f0b I1031 23:03:52.959676 32772 leader_election.cc:243] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. I1031 23:03:52.959801 27547 raft_consensus.cc:2162] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.971s I1031 23:03:52.959836 27547 raft_consensus.cc:1971] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election won for term 1 I1031 23:03:52.959846 27547 raft_consensus.cc:411] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I1031 23:03:52.959861 27547 raft_consensus.cc:2162] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.763s I1031 23:03:52.959870 27547 raft_consensus.cc:2206] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:03:52.960764 32828 raft_consensus.cc:2162] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.121s I1031 23:03:52.960783 32828 raft_consensus.cc:1747] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a8bbcbbb5a6459aa5258464755db3bb in term 0. I1031 23:03:52.962352 32828 raft_consensus.cc:2206] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:03:52.962388 32828 raft_consensus.cc:2162] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.197s I1031 23:03:52.962481 27547 raft_consensus.cc:435] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } I1031 23:03:52.962735 32828 raft_consensus.cc:1747] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a8bbcbbb5a6459aa5258464755db3bb in term 1. I1031 23:03:52.963028 27547 leader_election.cc:216] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 election: Requesting vote from peer 193181be29284287b25df2ee92938f0b I1031 23:03:52.963060 27547 leader_election.cc:216] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 election: Requesting vote from peer 0a8bbcbbb5a6459aa5258464755db3bb W1031 23:03:52.963388 32773 leader_election.cc:278] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:03:52.963824 32772 leader_election.cc:348] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 election: Vote granted by peer 193181be29284287b25df2ee92938f0b I1031 23:03:52.963850 32772 leader_election.cc:243] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I1031 23:03:52.963878 27547 raft_consensus.cc:2162] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.678s I1031 23:03:52.963896 27547 raft_consensus.cc:1971] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader election won for term 1 I1031 23:03:52.964061 27547 raft_consensus.cc:518] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 LEADER]: Becoming Leader. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: LEADER I1031 23:03:52.964105 27547 consensus_queue.cc:158] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } I1031 23:03:52.970844 32807 ts_tablet_manager.cc:862] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:53.004600 32815 ts_tablet_manager.cc:862] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:53.007146 32828 raft_consensus.cc:2162] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.648s I1031 23:03:53.007167 32828 raft_consensus.cc:1747] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daba39963d4346e1816089fd3a5442b5 in term 0. I1031 23:03:53.008524 32828 raft_consensus.cc:2206] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:03:53.008555 32828 raft_consensus.cc:2162] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.206s I1031 23:03:53.008910 32828 raft_consensus.cc:1747] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daba39963d4346e1816089fd3a5442b5 in term 1. I1031 23:03:53.024197 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:03:53.024235 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.073s I1031 23:03:53.024281 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:03:53.024701 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:03:53.024739 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:03:53.024961 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:03:53.025044 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:03:53.025066 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:03:53.025472 27576 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.521s I1031 23:03:53.025493 27576 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:03:53.038365 32817 ts_tablet_manager.cc:862] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:53.049438 27556 raft_consensus.cc:411] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:03:53.049473 27556 raft_consensus.cc:2162] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.085s I1031 23:03:53.049511 27556 raft_consensus.cc:435] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } I1031 23:03:53.050052 27556 leader_election.cc:216] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:03:53.050081 27556 leader_election.cc:216] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0fc477287c154136abc1e2f3c82fb7f9 W1031 23:03:53.050287 32773 leader_election.cc:278] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:03:53.050390 32771 leader_election.cc:278] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fc477287c154136abc1e2f3c82fb7f9: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:03:53.050421 32771 leader_election.cc:243] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:03:53.050509 27557 raft_consensus.cc:2162] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.967s I1031 23:03:53.050529 27557 raft_consensus.cc:1908] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:03:53.054198 27536 raft_consensus.cc:411] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:03:53.054227 27536 raft_consensus.cc:2162] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.144s I1031 23:03:53.054265 27536 raft_consensus.cc:435] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "0f53a0d3ef7e44ebb0365c800752d5bd" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st01.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:03:53.054791 27536 leader_election.cc:216] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:03:53.054819 27536 leader_election.cc:216] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0f53a0d3ef7e44ebb0365c800752d5bd I1031 23:03:53.055080 32772 leader_election.cc:348] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Vote granted by peer 193181be29284287b25df2ee92938f0b I1031 23:03:53.055094 32772 leader_election.cc:243] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. I1031 23:03:53.055130 27537 raft_consensus.cc:2162] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.540s I1031 23:03:53.055145 27537 raft_consensus.cc:1971] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election won for term 1 I1031 23:03:53.055155 27537 raft_consensus.cc:411] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I1031 23:03:53.055166 27537 raft_consensus.cc:2162] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.737s I1031 23:03:53.055176 27537 raft_consensus.cc:2206] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:03:53.055317 32770 leader_election.cc:348] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Vote granted by peer 0f53a0d3ef7e44ebb0365c800752d5bd I1031 23:03:53.055639 27537 raft_consensus.cc:435] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "0f53a0d3ef7e44ebb0365c800752d5bd" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st01.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:03:53.056089 27537 leader_election.cc:216] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 election: Requesting vote from peer 193181be29284287b25df2ee92938f0b I1031 23:03:53.056116 27537 leader_election.cc:216] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 election: Requesting vote from peer 0f53a0d3ef7e44ebb0365c800752d5bd I1031 23:03:53.056756 32772 leader_election.cc:348] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 election: Vote granted by peer 193181be29284287b25df2ee92938f0b I1031 23:03:53.056784 32772 leader_election.cc:243] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I1031 23:03:53.056813 27537 raft_consensus.cc:2162] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.242s I1031 23:03:53.056828 27537 raft_consensus.cc:1971] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader election won for term 1 I1031 23:03:53.057221 32770 leader_election.cc:348] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 election: Vote granted by peer 0f53a0d3ef7e44ebb0365c800752d5bd I1031 23:03:53.057227 27537 raft_consensus.cc:518] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 LEADER]: Becoming Leader. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: LEADER I1031 23:03:53.057273 27537 consensus_queue.cc:158] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 1, Majority size: 2, State: 1, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "0f53a0d3ef7e44ebb0365c800752d5bd" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st01.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:03:53.063609 32801 ts_tablet_manager.cc:862] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:53.097404 32814 ts_tablet_manager.cc:862] T 68aa6071fa594e79958cddb8489a1f0c P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:53.122566 32806 ts_tablet_manager.cc:862] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:53.147754 32809 ts_tablet_manager.cc:862] T 42d56cd12bbb4bed9973f96a230fdb9e P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:53.172963 32802 ts_tablet_manager.cc:862] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:53.198792 32805 ts_tablet_manager.cc:862] T fcde65c4e4cf4df29b9ef9884ce292b2 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:03:53.434947 32820 raft_consensus.cc:918] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 044f1da9a27c46acb82b1386f829f4dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:03:53.464802 32820 raft_consensus.cc:918] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 0a8bbcbbb5a6459aa5258464755db3bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:03:53.465030 27547 consensus_queue.cc:695] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [LEADER]: Connected to new peer: Peer: 193181be29284287b25df2ee92938f0b, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false W1031 23:03:53.465276 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 1 times. I1031 23:03:53.466760 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:03:53.466790 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.669s I1031 23:03:53.466831 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:03:53.467304 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:03:53.467334 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:03:53.467470 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:03:53.467607 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:03:53.467628 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:03:53.467691 27542 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.158s I1031 23:03:53.467711 27542 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:03:53.482890 32820 raft_consensus.cc:2162] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.584s I1031 23:03:53.482918 32820 raft_consensus.cc:1747] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 193181be29284287b25df2ee92938f0b in term 0. I1031 23:03:53.484222 32820 raft_consensus.cc:2206] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:03:53.484272 32820 raft_consensus.cc:2162] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.024s I1031 23:03:53.484712 32820 raft_consensus.cc:1747] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 193181be29284287b25df2ee92938f0b in term 1. I1031 23:03:53.511400 32820 raft_consensus.cc:918] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer daba39963d4346e1816089fd3a5442b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:03:53.558233 27537 consensus_queue.cc:695] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [LEADER]: Connected to new peer: Peer: 193181be29284287b25df2ee92938f0b, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false I1031 23:03:53.558745 27537 consensus_queue.cc:695] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241 [LEADER]: Connected to new peer: Peer: 0f53a0d3ef7e44ebb0365c800752d5bd, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false W1031 23:03:53.965456 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 2 times. I1031 23:03:53.985899 32820 raft_consensus.cc:918] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 193181be29284287b25df2ee92938f0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) W1031 23:03:54.410537 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 3 times. W1031 23:03:54.910682 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 4 times. W1031 23:03:55.410697 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 5 times. W1031 23:03:55.910815 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 6 times. W1031 23:03:56.410850 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 7 times. I1031 23:03:56.746621 27556 raft_consensus.cc:411] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:03:56.746670 27556 raft_consensus.cc:2162] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.576s I1031 23:03:56.746722 27556 raft_consensus.cc:435] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } I1031 23:03:56.747292 27556 leader_election.cc:216] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:03:56.747330 27556 leader_election.cc:216] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0fc477287c154136abc1e2f3c82fb7f9 W1031 23:03:56.747519 32773 leader_election.cc:278] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:03:56.747648 32771 leader_election.cc:278] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fc477287c154136abc1e2f3c82fb7f9: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:03:56.747669 32771 leader_election.cc:243] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:03:56.747843 27598 raft_consensus.cc:2162] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.296s I1031 23:03:56.747864 27598 raft_consensus.cc:1908] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:03:56.865144 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:03:56.865181 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.344s I1031 23:03:56.865217 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:03:56.865605 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:03:56.865629 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:03:56.865903 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:03:56.865945 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:03:56.865964 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:03:56.866258 27600 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.430s I1031 23:03:56.866281 27600 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:03:56.910936 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 8 times. W1031 23:03:57.411064 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 9 times. I1031 23:03:57.579069 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:03:57.579107 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.124s I1031 23:03:57.579149 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:03:57.579599 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:03:57.579640 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:03:57.579855 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:03:57.579913 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:03:57.579934 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:03:57.580418 27606 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.334s I1031 23:03:57.580440 27606 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:03:57.911134 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 10 times. I1031 23:03:58.087728 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:03:58.087764 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.849s I1031 23:03:58.087811 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:03:58.088369 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:03:58.088404 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:03:58.088685 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:03:58.088724 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:03:58.088734 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:03:58.088922 27622 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.842s I1031 23:03:58.088945 27622 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:03:58.411223 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 11 times. I1031 23:03:58.427884 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:03:58.427942 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.709s I1031 23:03:58.428006 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:03:58.428597 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:03:58.428622 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:03:58.428767 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:03:58.428958 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:03:58.428982 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:03:58.429323 27627 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.666s I1031 23:03:58.429343 27627 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:03:58.911432 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 12 times. W1031 23:03:59.411465 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 13 times. W1031 23:03:59.911525 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 14 times. W1031 23:04:00.411586 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 15 times. W1031 23:04:00.911698 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 16 times. I1031 23:04:01.034193 27556 raft_consensus.cc:411] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:01.034226 27556 raft_consensus.cc:2162] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.855s I1031 23:04:01.034286 27556 raft_consensus.cc:435] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } I1031 23:04:01.034844 27556 leader_election.cc:216] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:04:01.034875 27556 leader_election.cc:216] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0fc477287c154136abc1e2f3c82fb7f9 W1031 23:04:01.035171 32773 leader_election.cc:278] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:04:01.035341 32771 leader_election.cc:278] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fc477287c154136abc1e2f3c82fb7f9: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:04:01.035365 32771 leader_election.cc:243] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:01.035564 27638 raft_consensus.cc:2162] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.800s I1031 23:04:01.035585 27638 raft_consensus.cc:1908] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:01.411875 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 17 times. I1031 23:04:01.421216 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:01.421264 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.523s I1031 23:04:01.421325 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:04:01.421856 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:04:01.421887 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:04:01.422073 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:04:01.422163 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:04:01.422185 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:01.422619 27647 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.726s I1031 23:04:01.422641 27647 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:01.911893 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 18 times. W1031 23:04:02.411942 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 19 times. W1031 23:04:02.912042 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 20 times. I1031 23:04:03.044536 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:03.044575 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.780s I1031 23:04:03.044627 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:04:03.045123 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:04:03.045151 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:04:03.045440 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:04:03.045476 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:04:03.045490 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:03.045686 27663 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.903s I1031 23:04:03.045707 27663 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:03.412036 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 21 times. W1031 23:04:03.912206 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 22 times. W1031 23:04:04.412284 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 23 times. I1031 23:04:04.449545 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:04.449584 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.136s I1031 23:04:04.449635 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:04:04.450089 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:04:04.450129 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:04:04.450342 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:04:04.450407 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:04:04.450424 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:04.450656 27667 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.138s I1031 23:04:04.450678 27667 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:04:04.808513 27556 raft_consensus.cc:411] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:04.808569 27556 raft_consensus.cc:2162] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.567s I1031 23:04:04.808624 27556 raft_consensus.cc:435] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } I1031 23:04:04.809187 27556 leader_election.cc:216] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:04:04.809229 27556 leader_election.cc:216] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0fc477287c154136abc1e2f3c82fb7f9 W1031 23:04:04.809448 32773 leader_election.cc:278] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:04:04.809593 32771 leader_election.cc:278] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fc477287c154136abc1e2f3c82fb7f9: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:04:04.809617 32771 leader_election.cc:243] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:04.809821 27668 raft_consensus.cc:2162] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.818s I1031 23:04:04.809855 27668 raft_consensus.cc:1908] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:04.912487 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 24 times. W1031 23:04:05.412529 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 25 times. W1031 23:04:05.912709 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 26 times. W1031 23:04:06.412784 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 27 times. I1031 23:04:06.490661 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:06.490702 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.354s I1031 23:04:06.490746 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:04:06.491188 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:04:06.491210 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:04:06.491513 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:04:06.491556 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:04:06.491567 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:06.491758 27673 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.279s I1031 23:04:06.491780 27673 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:04:06.724017 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:06.724045 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.117s I1031 23:04:06.724083 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:04:06.724592 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:04:06.724628 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:04:06.724854 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:04:06.724985 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:04:06.725016 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:06.725194 27674 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.880s I1031 23:04:06.725214 27674 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:06.912879 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 28 times. W1031 23:04:07.413071 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 29 times. W1031 23:04:07.913053 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 30 times. I1031 23:04:08.347860 27556 raft_consensus.cc:411] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:08.347919 27556 raft_consensus.cc:2162] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.074s I1031 23:04:08.347980 27556 raft_consensus.cc:435] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } I1031 23:04:08.348572 27556 leader_election.cc:216] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:04:08.348598 27556 leader_election.cc:216] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0fc477287c154136abc1e2f3c82fb7f9 W1031 23:04:08.348810 32773 leader_election.cc:278] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:04:08.348959 32771 leader_election.cc:278] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fc477287c154136abc1e2f3c82fb7f9: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:04:08.348981 32771 leader_election.cc:243] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:08.349375 27698 raft_consensus.cc:2162] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.718s I1031 23:04:08.349395 27698 raft_consensus.cc:1908] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:08.413138 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 31 times. W1031 23:04:08.913249 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 32 times. W1031 23:04:09.413368 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 33 times. W1031 23:04:09.913437 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 34 times. W1031 23:04:10.413415 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 35 times. W1031 23:04:10.913589 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 36 times. W1031 23:04:11.413669 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 37 times. W1031 23:04:11.913717 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 38 times. W1031 23:04:12.284577 30391 log.cc:565] Time spent T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.060s user 0.000s sys 0.000s W1031 23:04:12.284633 30386 log.cc:565] Time spent T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.060s user 0.000s sys 0.000s W1031 23:04:12.413790 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 39 times. I1031 23:04:12.479156 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:12.479205 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.606s I1031 23:04:12.479256 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:04:12.479815 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:04:12.479837 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:04:12.480096 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:04:12.480135 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:04:12.480146 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:12.480723 27709 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.455s I1031 23:04:12.480758 27709 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:12.913955 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 40 times. I1031 23:04:13.270800 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:13.270848 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.628s I1031 23:04:13.270900 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:04:13.271397 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:04:13.271440 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:04:13.271798 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:04:13.271842 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:04:13.271869 32773 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:13.272007 27713 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.852s I1031 23:04:13.272034 27713 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:13.414068 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 41 times. I1031 23:04:13.733753 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:13.733791 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.963s I1031 23:04:13.733829 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:04:13.734259 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:04:13.734295 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:04:13.734460 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:04:13.734505 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:04:13.734524 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:13.734647 27717 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.418s I1031 23:04:13.734668 27717 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:13.914124 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 42 times. W1031 23:04:14.414198 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 43 times. W1031 23:04:14.914312 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 44 times. W1031 23:04:15.414361 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 45 times. I1031 23:04:15.465147 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:15.465206 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.914s I1031 23:04:15.465272 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:04:15.466359 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:04:15.466388 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:04:15.466653 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:04:15.466686 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:04:15.466706 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:15.466899 27731 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.620s I1031 23:04:15.466934 27731 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:15.914417 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 46 times. W1031 23:04:16.414454 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 47 times. W1031 23:04:16.914595 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 48 times. W1031 23:04:17.414837 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 49 times. I1031 23:04:17.572558 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:17.572609 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.343s I1031 23:04:17.572666 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:04:17.573164 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:04:17.573196 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:04:17.573412 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:04:17.573444 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:04:17.573472 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:17.573984 27749 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.372s I1031 23:04:17.574015 27749 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:17.914710 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 50 times. W1031 23:04:18.414916 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 51 times. W1031 23:04:18.914984 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 52 times. W1031 23:04:19.415068 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 53 times. I1031 23:04:19.809341 27556 raft_consensus.cc:411] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:19.809381 27556 raft_consensus.cc:2162] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.881s I1031 23:04:19.809437 27556 raft_consensus.cc:435] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } I1031 23:04:19.809998 27556 leader_election.cc:216] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:04:19.810029 27556 leader_election.cc:216] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0fc477287c154136abc1e2f3c82fb7f9 W1031 23:04:19.810220 32773 leader_election.cc:278] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:04:19.810366 32771 leader_election.cc:278] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fc477287c154136abc1e2f3c82fb7f9: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:04:19.810389 32771 leader_election.cc:243] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:19.810570 27774 raft_consensus.cc:2162] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.594s I1031 23:04:19.810590 27774 raft_consensus.cc:1908] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:19.915109 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 54 times. W1031 23:04:20.415321 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 55 times. W1031 23:04:20.915287 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 56 times. W1031 23:04:21.415364 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 57 times. W1031 23:04:21.915501 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 58 times. I1031 23:04:21.975949 32828 raft_consensus.cc:2162] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.523s I1031 23:04:21.975970 32828 raft_consensus.cc:1747] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fc477287c154136abc1e2f3c82fb7f9 in term 0. I1031 23:04:21.977746 32828 raft_consensus.cc:2206] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:04:21.977780 32828 raft_consensus.cc:2162] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.007s I1031 23:04:21.978332 32828 raft_consensus.cc:1747] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fc477287c154136abc1e2f3c82fb7f9 in term 1. W1031 23:04:22.419111 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 59 times. I1031 23:04:22.476183 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.476191 32802 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.476259 32805 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.476536 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.476552 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.477280 32802 tablet_service.cc:650] Processing CreateTablet for tablet bff7dab34ccd4b42842077e82106f6fb (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 0, RANGE (date) PARTITION 20171028 <= VALUES < 20171029 I1031 23:04:22.477449 32805 tablet_service.cc:650] Processing CreateTablet for tablet 46fc46e028434bc69f467922a9a59101 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 1, RANGE (date) PARTITION 20171030 <= VALUES < 20171031 I1031 23:04:22.477489 32809 tablet_service.cc:650] Processing CreateTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 3, RANGE (date) PARTITION 20171023 <= VALUES < 20171024 I1031 23:04:22.478196 32806 tablet_service.cc:650] Processing CreateTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 3, RANGE (date) PARTITION 20171028 <= VALUES < 20171029 I1031 23:04:22.478318 32801 tablet_service.cc:650] Processing CreateTablet for tablet 991306ec7acb449c89e5dd29d90e8d55 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 4, RANGE (date) PARTITION 20171031 <= VALUES < 20171101 I1031 23:04:22.478318 32814 tablet_service.cc:650] Processing CreateTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 4, RANGE (date) PARTITION 20171029 <= VALUES < 20171030 I1031 23:04:22.479874 32827 raft_consensus.cc:918] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 0fc477287c154136abc1e2f3c82fb7f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:04:22.510752 32817 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.510946 32817 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.514456 32817 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.540370 32817 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.540380 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.548136 32815 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.579180 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.581734 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.584273 32815 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.595646 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.648411 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.651866 32815 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.654297 32815 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.682572 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.704385 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.716347 32806 ts_tablet_manager.cc:862] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:04:22.741789 32814 ts_tablet_manager.cc:862] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:04:22.766932 32801 ts_tablet_manager.cc:862] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:04:22.792290 32805 ts_tablet_manager.cc:862] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:04:22.800925 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.817478 32809 ts_tablet_manager.cc:862] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:04:22.827895 32809 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.828078 32809 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.835573 32809 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:22.842607 32802 ts_tablet_manager.cc:862] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:04:22.852157 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:04:22.915679 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 60 times. I1031 23:04:23.070286 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:23.099129 32802 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:23.100452 32802 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:23.109225 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:23.126963 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:04:23.415829 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 61 times. I1031 23:04:23.617090 32802 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:23.619570 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:23.647469 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:23.659966 32802 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:23.686182 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:04:23.915822 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 62 times. W1031 23:04:24.416018 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 63 times. I1031 23:04:24.642771 32802 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:24.672009 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:24.695283 32802 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:24.697731 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:24.759832 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:04:24.916151 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 64 times. W1031 23:04:25.416141 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 65 times. I1031 23:04:25.577541 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:25.577594 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.047s I1031 23:04:25.577646 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:04:25.578210 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:04:25.578248 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:04:25.578523 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:04:25.578627 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:04:25.578651 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:25.579165 27803 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.251s I1031 23:04:25.579187 27803 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:04:25.771420 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:25.771456 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.440s I1031 23:04:25.771491 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:04:25.771924 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:04:25.771967 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:04:25.772187 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:04:25.772217 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:04:25.772241 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:25.772658 27804 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.357s I1031 23:04:25.772680 27804 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:25.916247 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 66 times. W1031 23:04:26.416388 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 67 times. I1031 23:04:26.739279 32802 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:26.744750 32802 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:26.749207 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:26.781262 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:26.813802 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:04:26.916591 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 68 times. W1031 23:04:27.416477 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 69 times. W1031 23:04:27.916611 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 70 times. W1031 23:04:28.416777 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 71 times. W1031 23:04:28.916813 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 72 times. W1031 23:04:29.417033 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 73 times. W1031 23:04:29.917064 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 74 times. W1031 23:04:30.417160 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 75 times. I1031 23:04:30.724936 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:30.724987 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.681s I1031 23:04:30.725059 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:04:30.725636 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:04:30.725659 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:04:30.725888 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:04:30.725975 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:04:30.725998 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:30.726524 28028 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.439s I1031 23:04:30.726547 28028 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:04:30.879806 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:30.879812 32809 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:30.881242 32802 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:30.886996 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:04:30.917181 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 76 times. I1031 23:04:30.940068 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:04:31.417338 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 77 times. W1031 23:04:31.917353 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 78 times. W1031 23:04:32.417368 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 79 times. W1031 23:04:32.917501 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 80 times. W1031 23:04:33.417534 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 81 times. W1031 23:04:33.917654 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 82 times. W1031 23:04:34.417776 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 83 times. I1031 23:04:34.691507 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:34.691566 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.466s I1031 23:04:34.691627 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:04:34.692147 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:04:34.692172 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:04:34.692361 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:04:34.692414 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:04:34.692430 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:34.693068 28058 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.800s I1031 23:04:34.693104 28058 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:34.917778 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 84 times. I1031 23:04:35.034472 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:35.034519 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.335s I1031 23:04:35.034569 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:04:35.035078 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:04:35.035114 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:04:35.035363 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:04:35.035454 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:04:35.035485 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:35.035676 28077 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.149s I1031 23:04:35.035704 28077 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:35.417945 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 85 times. W1031 23:04:35.924013 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 86 times. I1031 23:04:36.172688 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:36.172742 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.170s I1031 23:04:36.172806 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:04:36.173370 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:04:36.173399 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:04:36.173583 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:04:36.173635 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:04:36.173655 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:36.173902 28081 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.999s I1031 23:04:36.173923 28081 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:36.418040 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 87 times. W1031 23:04:36.918226 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 88 times. W1031 23:04:37.418269 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 89 times. W1031 23:04:37.918242 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 90 times. W1031 23:04:38.418568 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 91 times. W1031 23:04:38.918493 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 92 times. I1031 23:04:39.103823 32802 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:39.106178 32802 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:39.117660 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:39.120124 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:39.133108 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:04:39.418615 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 93 times. W1031 23:04:39.918661 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 94 times. W1031 23:04:40.418905 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 95 times. W1031 23:04:40.918859 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 96 times. W1031 23:04:41.419122 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 97 times. W1031 23:04:41.919009 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 98 times. W1031 23:04:42.419164 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 99 times. I1031 23:04:42.649780 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:42.649838 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.638s I1031 23:04:42.649897 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:04:42.650480 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:04:42.650518 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:04:42.650741 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:04:42.650820 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:04:42.650843 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:42.651163 28132 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.035s I1031 23:04:42.651186 28132 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:42.919255 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 100 times. W1031 23:04:43.419369 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 101 times. W1031 23:04:43.919392 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 102 times. W1031 23:04:44.419562 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 103 times. W1031 23:04:44.919633 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 104 times. W1031 23:04:45.419670 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 105 times. W1031 23:04:45.919807 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 106 times. W1031 23:04:46.419930 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 107 times. W1031 23:04:46.919950 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 108 times. W1031 23:04:47.420192 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 109 times. W1031 23:04:47.769251 30391 log.cc:565] Time spent T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.057s user 0.000s sys 0.000s W1031 23:04:47.769255 30386 log.cc:565] Time spent T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.051s user 0.000s sys 0.000s I1031 23:04:47.778627 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:47.778657 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.466s I1031 23:04:47.778710 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:04:47.779229 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:04:47.779259 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:04:47.779475 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:04:47.779505 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:04:47.779528 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:47.780023 28152 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.103s I1031 23:04:47.780045 28152 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:47.920127 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 110 times. W1031 23:04:48.420301 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 111 times. W1031 23:04:48.920337 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 112 times. W1031 23:04:49.420464 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 113 times. W1031 23:04:49.920501 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 114 times. I1031 23:04:50.114600 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:50.114640 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.204s I1031 23:04:50.114706 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:04:50.115272 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:04:50.115306 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:04:50.115527 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:04:50.115561 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:04:50.115576 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:50.116130 28189 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.915s I1031 23:04:50.116153 28189 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:50.420616 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 115 times. W1031 23:04:50.920778 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 116 times. W1031 23:04:51.420779 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 117 times. W1031 23:04:51.921023 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 118 times. W1031 23:04:52.420964 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 119 times. I1031 23:04:52.500991 32802 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.501324 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.501394 32802 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.501771 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.502132 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.502207 32809 tablet_service.cc:650] Processing CreateTablet for tablet 005a48fb466c4a52896842dd00124755 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 0, RANGE (date) PARTITION 20171028 <= VALUES < 20171029 I1031 23:04:52.502871 32802 tablet_service.cc:650] Processing CreateTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 0, RANGE (date) PARTITION 20171029 <= VALUES < 20171030 I1031 23:04:52.502882 32805 tablet_service.cc:650] Processing CreateTablet for tablet 7d1359dc00a24df68d41c2447e367f1d (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 1, RANGE (date) PARTITION 20171030 <= VALUES < 20171031 I1031 23:04:52.502984 32801 tablet_service.cc:650] Processing CreateTablet for tablet 32984b820db347e1b2d4d0786cf221f2 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 3, RANGE (date) PARTITION 20171028 <= VALUES < 20171029 I1031 23:04:52.523051 32814 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.558539 32814 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.559952 32814 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.561334 32814 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.564784 32806 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.564790 32814 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.597513 32806 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.613263 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.619904 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.629200 32806 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.639782 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.694661 32806 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.697125 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.718097 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.739656 32806 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.743793 32802 ts_tablet_manager.cc:862] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:04:52.768914 32809 ts_tablet_manager.cc:862] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:04:52.771715 32809 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.794209 32801 ts_tablet_manager.cc:862] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:04:52.819470 32805 ts_tablet_manager.cc:862] T 7d1359dc00a24df68d41c2447e367f1d P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:04:52.828003 32805 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.850352 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.870761 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:52.914644 32805 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:04:52.921056 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 120 times. I1031 23:04:53.000790 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:53.000821 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.112s I1031 23:04:53.000874 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:04:53.001441 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:04:53.001466 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:04:53.001722 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:04:53.001767 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:04:53.001798 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:53.001983 28206 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.994s I1031 23:04:53.002004 28206 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:04:53.030298 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:53.097965 32805 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:53.116678 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:53.172932 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:53.208281 32805 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:04:53.421273 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 121 times. I1031 23:04:53.587055 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:53.629307 32805 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:53.677624 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:53.707024 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:53.740521 32805 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:04:53.921254 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 122 times. W1031 23:04:54.421391 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 123 times. I1031 23:04:54.653913 32805 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:54.658399 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:54.746103 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:54.765998 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:54.770500 32805 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:04:54.921439 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 124 times. W1031 23:04:55.421560 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 125 times. I1031 23:04:55.488564 32805 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:55.517387 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:55.517628 32805 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:55.525377 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:55.567260 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:55.758699 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:55.758738 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.155s I1031 23:04:55.758795 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:04:55.759299 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:04:55.759325 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:04:55.759546 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:04:55.759589 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:04:55.759613 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:55.759944 28216 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.778s I1031 23:04:55.759965 28216 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:55.921619 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 126 times. W1031 23:04:56.421718 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 127 times. I1031 23:04:56.731304 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:56.751330 32805 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:56.813683 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:56.841804 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:04:56.850234 32805 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:04:56.921785 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 128 times. W1031 23:04:57.421958 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 129 times. W1031 23:04:57.921947 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 130 times. I1031 23:04:58.017817 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:04:58.017868 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.499s I1031 23:04:58.017925 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:04:58.018509 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:04:58.018538 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:04:58.018824 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:04:58.018882 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:04:58.018903 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:04:58.019140 28240 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.151s I1031 23:04:58.019161 28240 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:04:58.422097 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 131 times. W1031 23:04:58.922158 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 132 times. W1031 23:04:59.422235 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 133 times. W1031 23:04:59.922276 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 134 times. W1031 23:05:00.422428 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 135 times. I1031 23:05:00.850169 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:00.891793 32805 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:05:00.922425 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 136 times. I1031 23:05:00.938417 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:00.944846 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:00.958613 32805 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:01.260442 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:01.260480 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.616s I1031 23:05:01.260532 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:05:01.261169 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:05:01.261199 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:05:01.261427 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:05:01.261579 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:05:01.261611 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:01.262151 28253 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.585s I1031 23:05:01.262172 28253 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:05:01.422683 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 137 times. W1031 23:05:01.922770 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 138 times. W1031 23:05:02.422844 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 139 times. W1031 23:05:02.922991 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 140 times. I1031 23:05:03.326287 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:03.326334 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.597s I1031 23:05:03.326382 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:05:03.326953 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:05:03.326978 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:05:03.327170 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:05:03.327275 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:05:03.327294 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:03.327551 28272 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.764s I1031 23:05:03.327586 28272 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:05:03.422966 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 141 times. W1031 23:05:03.923074 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 142 times. W1031 23:05:04.423178 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 143 times. W1031 23:05:04.923295 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 144 times. W1031 23:05:05.423384 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 145 times. W1031 23:05:05.923395 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 146 times. W1031 23:05:06.423535 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 147 times. W1031 23:05:06.923656 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 148 times. W1031 23:05:07.423686 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 149 times. W1031 23:05:07.923851 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 150 times. W1031 23:05:08.424024 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 151 times. W1031 23:05:08.923985 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 152 times. I1031 23:05:09.091989 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:09.103154 32805 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:09.135663 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:09.179080 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:09.196605 32805 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:05:09.424055 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 153 times. W1031 23:05:09.924190 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 154 times. W1031 23:05:10.424290 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 155 times. W1031 23:05:10.924341 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 156 times. W1031 23:05:11.424530 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 157 times. I1031 23:05:11.773231 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:11.773272 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.182s I1031 23:05:11.773330 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:05:11.773838 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:05:11.773864 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:05:11.774058 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:05:11.774160 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:05:11.774191 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:11.774790 28320 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.156s I1031 23:05:11.774811 28320 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:05:11.924490 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 158 times. I1031 23:05:12.095865 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:12.095890 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.438s I1031 23:05:12.095927 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:05:12.096390 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:05:12.096415 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:05:12.096662 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:05:12.096750 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:05:12.096772 32773 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:12.096951 28321 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.621s I1031 23:05:12.096982 28321 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:05:12.424640 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 159 times. W1031 23:05:12.924723 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 160 times. W1031 23:05:13.253276 30396 log.cc:565] Time spent T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.172s user 0.000s sys 0.000s W1031 23:05:13.253288 30391 log.cc:565] Time spent T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.133s user 0.000s sys 0.000s W1031 23:05:13.253353 30386 log.cc:565] Time spent T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.218s user 0.000s sys 0.000s W1031 23:05:13.424901 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 161 times. W1031 23:05:13.924877 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 162 times. W1031 23:05:14.424964 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 163 times. I1031 23:05:14.645709 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:14.645751 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.612s I1031 23:05:14.645810 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:05:14.646373 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:05:14.646399 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:05:14.646555 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:05:14.646651 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:05:14.646674 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:14.646816 28331 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.179s I1031 23:05:14.646836 28331 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:05:14.924994 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 164 times. W1031 23:05:15.425086 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 165 times. I1031 23:05:15.733497 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:15.733526 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.742s I1031 23:05:15.733574 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:05:15.734097 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:05:15.734122 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:05:15.734382 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:05:15.734414 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:05:15.734434 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:15.734616 28336 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.459s I1031 23:05:15.734637 28336 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:05:15.925122 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 166 times. W1031 23:05:16.425218 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 167 times. W1031 23:05:16.925269 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 168 times. W1031 23:05:17.425325 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 169 times. I1031 23:05:17.651532 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:17.651581 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.489s I1031 23:05:17.651629 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:05:17.652281 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:05:17.652307 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:05:17.652510 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:05:17.652545 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:05:17.652565 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:17.652757 28338 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.058s I1031 23:05:17.652779 28338 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:05:17.925410 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 170 times. W1031 23:05:18.425462 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 171 times. W1031 23:05:18.925555 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 172 times. W1031 23:05:19.425621 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 173 times. I1031 23:05:19.672210 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:19.672271 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.728s I1031 23:05:19.672319 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:05:19.672961 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:05:19.672986 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:05:19.673209 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:05:19.673238 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:05:19.673249 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:19.673378 28357 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.814s I1031 23:05:19.673399 28357 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:05:19.925710 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 174 times. W1031 23:05:20.425753 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 175 times. W1031 23:05:20.925808 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 176 times. W1031 23:05:21.425894 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 177 times. W1031 23:05:21.926007 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 178 times. W1031 23:05:22.426072 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 179 times. I1031 23:05:22.525157 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:22.525195 32801 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:22.525943 32801 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:22.525976 32805 tablet_service.cc:650] Processing CreateTablet for tablet db5874009dd84d4892fccdb3316010c2 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 0, RANGE (date) PARTITION 20171024 <= VALUES < 20171025 I1031 23:05:22.526265 32801 tablet_service.cc:650] Processing CreateTablet for tablet f2af422919fd4560bd6441509a68d64b (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 0, RANGE (date) PARTITION 20171028 <= VALUES < 20171029 I1031 23:05:22.526299 32802 tablet_service.cc:650] Processing CreateTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 1, RANGE (date) PARTITION 20171026 <= VALUES < 20171027 I1031 23:05:22.526862 32809 tablet_service.cc:650] Processing CreateTablet for tablet 47eeb8448c454968a45bf1a984427b25 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 0, RANGE (date) PARTITION 20171029 <= VALUES < 20171030 I1031 23:05:22.527035 32806 tablet_service.cc:650] Processing CreateTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 4, RANGE (date) PARTITION 20171025 <= VALUES < 20171026 I1031 23:05:22.543836 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:22.543838 32814 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:22.548691 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:22.603513 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:22.620491 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:22.626096 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:22.644294 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:22.644337 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.287s I1031 23:05:22.644387 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:05:22.644951 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:05:22.644984 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:05:22.645184 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:05:22.645226 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:05:22.645244 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:22.645431 28368 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.142s I1031 23:05:22.645453 28368 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:05:22.693019 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:22.693020 32814 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:22.724215 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:22.770298 32802 ts_tablet_manager.cc:862] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:05:22.795619 32801 ts_tablet_manager.cc:862] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:05:22.820806 32805 ts_tablet_manager.cc:862] T db5874009dd84d4892fccdb3316010c2 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:05:22.838805 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:22.844353 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:22.846046 32809 ts_tablet_manager.cc:862] T 47eeb8448c454968a45bf1a984427b25 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:05:22.871232 32806 ts_tablet_manager.cc:862] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:05:22.879571 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:05:22.926115 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 180 times. I1031 23:05:23.108949 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:23.124435 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:23.138690 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:05:23.426275 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 181 times. I1031 23:05:23.644771 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:23.664618 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:23.692227 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:05:23.926187 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 182 times. W1031 23:05:24.426286 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 183 times. I1031 23:05:24.704819 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:24.715287 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:24.729192 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:05:24.926434 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 184 times. W1031 23:05:25.426421 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 185 times. I1031 23:05:25.501063 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:25.508960 32806 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:25.547101 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:25.599210 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:25.628768 32806 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:05:25.926539 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 186 times. W1031 23:05:26.426587 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 187 times. I1031 23:05:26.776953 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:26.783517 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:26.823129 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:05:26.926617 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 188 times. W1031 23:05:27.426743 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 189 times. W1031 23:05:27.926884 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 190 times. I1031 23:05:28.269337 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:28.288650 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:28.297233 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:28.334302 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:05:28.353715 30386 log.cc:565] Time spent T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.186s user 0.000s sys 0.000s I1031 23:05:28.369308 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:05:28.426955 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 191 times. W1031 23:05:28.926982 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 192 times. W1031 23:05:29.427114 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 193 times. W1031 23:05:29.927062 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 194 times. W1031 23:05:30.427287 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 195 times. I1031 23:05:30.892277 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:30.898818 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:05:30.927182 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 196 times. I1031 23:05:30.942684 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 W1031 23:05:31.427400 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 197 times. W1031 23:05:31.927340 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 198 times. I1031 23:05:32.044402 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:32.044443 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.945s I1031 23:05:32.044503 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:05:32.045095 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:05:32.045121 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:05:32.045358 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:05:32.045390 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:05:32.045408 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:32.045537 28598 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.838s I1031 23:05:32.045557 28598 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:05:32.427538 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 199 times. W1031 23:05:32.927639 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 200 times. W1031 23:05:33.427680 32773 consensus_peers.cc:357] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 -> Peer 0a8bbcbbb5a6459aa5258464755db3bb (c3-kudu-tst-st02.bj:18700): Couldn't send request to peer 0a8bbcbbb5a6459aa5258464755db3bb for tablet 9967925d5dbd49eaadc0a1a58e7e2089. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: NOT_STARTED. Retrying in the next heartbeat period. Already tried 201 times. I1031 23:05:33.628484 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:33.628525 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.627s I1031 23:05:33.628584 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:05:33.629106 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:05:33.629143 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:05:33.629353 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:05:33.629427 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Illegal state: Tablet not RUNNING: NOT_STARTED I1031 23:05:33.629452 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:33.629626 28603 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.279s I1031 23:05:33.629647 28603 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:05:33.961925 27573 consensus_queue.cc:695] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241 [LEADER]: Connected to new peer: Peer: 0a8bbcbbb5a6459aa5258464755db3bb, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false I1031 23:05:34.201814 32834 raft_consensus.cc:1708] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a8bbcbbb5a6459aa5258464755db3bb for term 1 because replica is either leader or believes a valid leader to be alive. I1031 23:05:34.204388 32834 raft_consensus.cc:1708] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a8bbcbbb5a6459aa5258464755db3bb for term 1 because replica is either leader or believes a valid leader to be alive. I1031 23:05:34.385516 32837 raft_consensus.cc:1708] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a8bbcbbb5a6459aa5258464755db3bb for term 1 because replica is either leader or believes a valid leader to be alive. I1031 23:05:34.551164 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:34.551198 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.163s I1031 23:05:34.551252 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:05:34.551767 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:05:34.551790 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:05:34.552001 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:05:34.552085 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:05:34.552104 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:34.552363 28616 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.779s I1031 23:05:34.552388 28616 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:05:34.640718 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:34.640745 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.301s I1031 23:05:34.640784 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:05:34.641217 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:05:34.641242 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:05:34.641505 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:05:34.641552 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:05:34.641567 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:34.641750 28619 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.156s I1031 23:05:34.641772 28619 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:05:35.179422 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:35.179458 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.335s I1031 23:05:35.179502 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:05:35.179934 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:05:35.179978 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:05:35.180244 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:05:35.180318 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:05:35.180348 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:35.180929 28625 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.727s I1031 23:05:35.180951 28625 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:05:39.114843 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:39.124737 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:39.144850 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:39.549674 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:39.549715 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.180s I1031 23:05:39.549783 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:05:39.550317 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:05:39.550341 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:05:39.550614 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:05:39.550691 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:05:39.550721 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:39.551183 28659 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.926s I1031 23:05:39.551205 28659 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:05:43.931841 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:43.931891 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.751s I1031 23:05:43.931953 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:05:43.932494 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:05:43.932518 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:05:43.932711 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:05:43.932756 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:05:43.932782 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:43.933338 28679 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.608s I1031 23:05:43.933367 28679 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:05:44.104032 30386 log.cc:565] Time spent T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.203s user 0.000s sys 0.000s W1031 23:05:44.104038 30396 log.cc:565] Time spent T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.211s user 0.000s sys 0.000s I1031 23:05:44.378962 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:44.378988 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.223s I1031 23:05:44.379036 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:05:44.379531 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:05:44.379554 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:05:44.379832 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:05:44.379900 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:05:44.379925 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:44.380122 28681 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.778s I1031 23:05:44.380144 28681 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:05:45.992084 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:45.992132 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.382s I1031 23:05:45.992189 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:05:45.992804 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:05:45.992830 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:05:45.993072 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:05:45.993170 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:05:45.993201 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:45.993438 28687 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.516s I1031 23:05:45.993460 28687 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:05:49.752964 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:49.753013 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.739s I1031 23:05:49.753074 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:05:49.753636 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:05:49.753661 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:05:49.753931 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Illegal state: Tablet not RUNNING: NOT_STARTED W1031 23:05:49.753971 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:05:49.753998 32773 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:49.754505 28721 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.435s I1031 23:05:49.754528 28721 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:05:51.428102 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:51.428133 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.963s I1031 23:05:51.428189 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:05:51.428683 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:05:51.428715 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:05:51.429095 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:05:51.429142 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:05:51.429157 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:51.429338 28730 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.979s I1031 23:05:51.429361 28730 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:05:52.218683 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:52.218737 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.791s I1031 23:05:52.218798 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:05:52.219295 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:05:52.219328 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:05:52.219586 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:05:52.219661 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:05:52.219688 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:52.219928 28731 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.091s I1031 23:05:52.219949 28731 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:05:52.547650 32809 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:52.547660 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:52.547971 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:52.548280 32809 tablet_service.cc:650] Processing CreateTablet for tablet bb4c891b261b42ef9b983f46cefef6ae (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 1, RANGE (date) PARTITION 20171027 <= VALUES < 20171028 I1031 23:05:52.548280 32806 tablet_service.cc:650] Processing CreateTablet for tablet 8566e0c79e674a74803cd1a15fec8cb2 (table=default.timeout_tst [id=cdcb3e60c1314776843d856365535d49]), partition=HASH (id) PARTITION 1, RANGE (date) PARTITION 20171026 <= VALUES < 20171027 I1031 23:05:52.588491 32805 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:52.593037 32805 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:52.608008 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:52.629473 32805 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:52.634001 32805 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:52.666491 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:52.715903 32805 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:52.727310 32805 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:52.765121 32805 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:52.789096 32809 ts_tablet_manager.cc:862] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:05:52.814342 32806 ts_tablet_manager.cc:862] T 8566e0c79e674a74803cd1a15fec8cb2 P 23f962e4a1744381ad5fa0d2d8b10241: Registered tablet (data state: TABLET_DATA_READY) I1031 23:05:52.887092 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:52.891607 32806 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:52.913154 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:53.157228 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:53.197722 32806 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:53.202137 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:53.691848 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:53.715396 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:53.716747 32806 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:54.728545 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:54.758196 32806 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:54.775665 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:55.533725 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:55.535081 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:55.550551 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:55.563335 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:55.563387 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.218s I1031 23:05:55.563437 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:05:55.563967 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:05:55.564010 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:05:55.564297 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:05:55.564337 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:05:55.564352 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:55.564757 28741 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.497s I1031 23:05:55.564779 28741 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:05:56.798629 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:56.843276 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:56.849750 32806 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:57.244652 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:57.244683 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.346s I1031 23:05:57.244730 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:05:57.245215 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:05:57.245239 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:05:57.245473 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:05:57.245509 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:05:57.245539 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:57.245721 28748 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.139s I1031 23:05:57.245743 28748 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:05:58.061327 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:58.061365 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.406s I1031 23:05:58.061415 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:05:58.061848 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:05:58.061875 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:05:58.062073 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:05:58.062157 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:05:58.062182 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:58.062312 28766 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.636s I1031 23:05:58.062337 28766 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:05:58.289518 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:58.312463 32806 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:58.346447 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:58.376760 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:58.421252 32806 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:05:58.754546 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:05:58.754591 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.548s I1031 23:05:58.754652 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:05:58.755239 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:05:58.755264 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:05:58.755540 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:05:58.755584 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:05:58.755594 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:05:58.755904 28770 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.036s I1031 23:05:58.755928 28770 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:00.932251 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:00.945802 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:00.985291 32806 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:06.992709 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:06.992751 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.708s I1031 23:06:06.992801 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:06:06.993273 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:06:06.993299 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:06:06.993566 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:06:06.993602 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:06:06.993621 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:06.993906 28799 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.534s I1031 23:06:06.993935 28799 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:08.155899 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:08.155958 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.908s I1031 23:06:08.156025 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:06:08.156529 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:06:08.156560 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:06:08.156767 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:06:08.156910 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:06:08.156930 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:08.157179 28818 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.714s I1031 23:06:08.157202 28818 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:09.148295 32809 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:09.148311 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:09.190780 32809 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:10.559252 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:10.559289 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.153s I1031 23:06:10.559335 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:06:10.559821 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:06:10.559846 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:06:10.560082 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:06:10.560168 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:06:10.560191 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:10.560565 28826 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.059s I1031 23:06:10.560586 28826 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:12.618281 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:12.618327 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.632s I1031 23:06:12.618379 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:06:12.618891 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:06:12.618914 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:06:12.619105 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:06:12.619134 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:06:12.619158 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:12.619290 28832 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.761s I1031 23:06:12.619314 28832 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:13.829474 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:13.829520 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.824s I1031 23:06:13.829568 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:06:13.830068 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:06:13.830101 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:06:13.830320 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:06:13.830354 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:06:13.830377 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:13.830560 28862 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.532s I1031 23:06:13.830584 28862 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:06:19.396793 30386 log.cc:565] Time spent T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.174s user 0.000s sys 0.000s W1031 23:06:19.396795 30391 log.cc:565] Time spent T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.171s user 0.000s sys 0.000s I1031 23:06:23.364910 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:23.364954 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.126s I1031 23:06:23.365020 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:06:23.365504 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:06:23.365542 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:06:23.365759 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:06:23.365859 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:06:23.365881 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:23.366379 28921 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.463s I1031 23:06:23.366400 28921 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:23.393285 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:23.393311 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.170s I1031 23:06:23.393347 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:06:23.393744 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:06:23.393769 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:06:23.393951 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:06:23.394047 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:06:23.394067 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:23.394517 28922 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.459s I1031 23:06:23.394538 28922 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:25.550596 32809 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:25.572089 32809 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:25.624480 32809 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:28.291496 32809 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:28.311776 32809 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:28.314282 32809 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:28.314316 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:28.314491 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:28.340595 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:28.364493 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:28.369982 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:28.927011 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:28.927049 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.307s I1031 23:06:28.927108 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:06:28.927578 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:06:28.927608 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:06:28.927878 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:06:28.927925 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:06:28.927949 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:28.928138 29133 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.587s I1031 23:06:28.928160 29133 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:29.444870 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:29.444898 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.588s I1031 23:06:29.444941 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:06:29.445394 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:06:29.445422 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:06:29.445633 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:06:29.445744 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:06:29.445772 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:29.446064 29137 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.803s I1031 23:06:29.446086 29137 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:31.147020 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:31.147061 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.746s I1031 23:06:31.147120 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:06:31.147632 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:06:31.147660 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:06:31.147891 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:06:31.147928 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:06:31.147938 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:31.148064 29144 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.887s I1031 23:06:31.148087 29144 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:34.098163 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:34.098206 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.496s I1031 23:06:34.098280 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:06:34.098810 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:06:34.098837 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:06:34.099135 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:06:34.099190 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:06:34.099207 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:34.099468 29154 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.658s I1031 23:06:34.099494 29154 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:35.587451 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:35.587492 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.904s I1031 23:06:35.587545 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:06:35.588052 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:06:35.588079 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:06:35.588228 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:06:35.588378 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:06:35.588402 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:35.588860 29158 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.548s I1031 23:06:35.588881 29158 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:40.887101 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:40.887147 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.631s I1031 23:06:40.887203 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:06:40.887701 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:06:40.887727 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:06:40.887954 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:06:40.888007 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:06:40.888029 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:40.888268 29193 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.114s I1031 23:06:40.888289 29193 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:43.879526 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:43.879572 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.542s I1031 23:06:43.879629 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:06:43.880208 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:06:43.880236 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:06:43.880530 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:06:43.880645 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:06:43.880672 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:43.880913 29200 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.877s I1031 23:06:43.880934 29200 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:44.461455 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:44.461483 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.387s I1031 23:06:44.461529 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:06:44.461971 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:06:44.462009 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:06:44.462193 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:06:44.462254 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:06:44.462276 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:44.462620 29203 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.323s I1031 23:06:44.462644 29203 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:44.875573 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:44.875604 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.133s I1031 23:06:44.875655 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:06:44.876124 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:06:44.876150 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:06:44.876420 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:06:44.876484 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:06:44.876508 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:44.876747 29204 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.441s I1031 23:06:44.876770 29204 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:49.538050 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:49.538094 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.356s I1031 23:06:49.538149 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:06:49.538740 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:06:49.538779 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:06:49.539036 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:06:49.539105 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:06:49.539134 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:49.539455 29236 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.095s I1031 23:06:49.539476 29236 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:50.224817 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:50.224856 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.761s I1031 23:06:50.224901 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:06:50.225459 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:06:50.225486 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:06:50.225693 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:06:50.225770 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:06:50.225791 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:50.226351 29238 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.263s I1031 23:06:50.226371 29238 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:55.694087 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:55.694133 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.135s I1031 23:06:55.694195 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:06:55.694722 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:06:55.694752 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:06:55.694969 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:06:55.695019 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:06:55.695039 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:55.695441 29256 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.538s I1031 23:06:55.695463 29256 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:56.667955 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:56.668004 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.148s I1031 23:06:56.668061 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:06:56.668684 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:06:56.668712 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:06:56.668962 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:06:56.669009 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:06:56.669023 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:56.669620 29259 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.198s I1031 23:06:56.669643 29259 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:56.698750 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:56.698777 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.375s I1031 23:06:56.698823 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:06:56.699350 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:06:56.699383 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:06:56.699626 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:06:56.699735 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:06:56.699757 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:56.699934 29260 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.992s I1031 23:06:56.699954 29260 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:57.324941 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:57.324970 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.548s I1031 23:06:57.325021 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:06:57.325516 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:06:57.325543 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:06:57.325783 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:06:57.325862 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:06:57.325887 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:57.326079 29261 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.609s I1031 23:06:57.326102 29261 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:57.440896 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:06:57.440925 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.119s I1031 23:06:57.440970 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:06:57.441370 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:06:57.441406 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:06:57.441669 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:06:57.441704 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:06:57.441726 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:06:57.442277 29263 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.638s I1031 23:06:57.442303 29263 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:06:58.294885 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:58.322363 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:58.345331 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:58.350813 32806 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:58.386714 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:58.389168 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:58.403682 32806 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:06:58.436547 32806 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:01.801983 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:01.802049 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.496s I1031 23:07:01.802115 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:07:01.802675 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:07:01.802702 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:07:01.802930 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:07:01.802965 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:07:01.802983 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:01.803169 29341 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.631s I1031 23:07:01.803197 29341 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:05.895539 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:05.895586 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.514s I1031 23:07:05.895661 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:07:05.896256 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:07:05.896286 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:07:05.896474 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:07:05.896523 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:07:05.896556 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:05.896761 29425 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.241s I1031 23:07:05.896782 29425 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:08.496736 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:08.496779 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.064s I1031 23:07:08.496835 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:07:08.497455 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:07:08.497491 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:07:08.497714 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:07:08.497758 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:07:08.497781 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:08.498021 29446 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.344s I1031 23:07:08.498042 29446 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:08.569591 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:08.569628 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.147s I1031 23:07:08.569669 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:07:08.570207 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:07:08.570235 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:07:08.570499 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:07:08.570533 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:07:08.570545 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:08.571115 29447 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.191s I1031 23:07:08.571137 29447 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:13.447016 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:13.447062 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.808s I1031 23:07:13.447129 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:07:13.447691 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:07:13.447720 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:07:13.447978 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:07:13.448016 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:07:13.448036 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:13.448272 29465 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.253s I1031 23:07:13.448299 29465 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:15.680784 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:15.680830 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.436s I1031 23:07:15.680889 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:07:15.681396 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:07:15.681423 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:07:15.681632 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:07:15.681792 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:07:15.681816 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:15.682121 29472 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.639s I1031 23:07:15.682157 29472 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:17.366812 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:17.366845 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.680s I1031 23:07:17.366892 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:07:17.367347 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:07:17.367374 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:07:17.367641 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:07:17.367727 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:07:17.367753 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:17.367935 29482 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.304s I1031 23:07:17.367956 29482 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:19.121294 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:19.121335 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.325s I1031 23:07:19.121390 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:07:19.121929 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:07:19.121953 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:07:19.122098 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:07:19.122134 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:07:19.122154 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:19.122341 29503 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.958s I1031 23:07:19.122366 29503 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:20.552467 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:20.552500 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.136s I1031 23:07:20.552552 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:07:20.553048 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:07:20.553078 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:07:20.553396 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found W1031 23:07:20.553427 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:07:20.553460 32773 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:20.553652 29509 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.377s I1031 23:07:20.553671 29509 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:23.575183 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:23.575224 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.442s I1031 23:07:23.575285 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:07:23.575778 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:07:23.575806 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:07:23.576043 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:07:23.576094 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:07:23.576114 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:23.576711 29522 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.421s I1031 23:07:23.576748 29522 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:28.301471 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:28.319092 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:28.331589 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:28.337429 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:28.362972 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:28.375535 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:28.401952 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:28.419389 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:28.966449 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:28.966491 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.033s I1031 23:07:28.966552 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:07:28.967109 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:07:28.967135 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:07:28.967286 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:07:28.967372 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:07:28.967394 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:28.967571 29728 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.091s I1031 23:07:28.967592 29728 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:30.256203 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:30.256237 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.247s I1031 23:07:30.256285 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:07:30.256747 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:07:30.256775 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:07:30.256906 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:07:30.257019 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:07:30.257040 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:30.257228 29737 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.537s I1031 23:07:30.257251 29737 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:33.492972 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:33.493024 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.208s I1031 23:07:33.493089 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:07:33.493592 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:07:33.493620 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:07:33.493832 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:07:33.493944 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:07:33.493978 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:33.494556 29743 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.441s I1031 23:07:33.494576 29743 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:39.621716 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:39.621775 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.487s I1031 23:07:39.621852 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:07:39.622532 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:07:39.622575 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:07:39.622824 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:07:39.622880 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:07:39.622891 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:39.623180 29786 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.671s I1031 23:07:39.623200 29786 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:39.921979 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:39.922015 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.806s I1031 23:07:39.922051 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:07:39.922462 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:07:39.922494 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:07:39.922735 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:07:39.922853 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:07:39.922883 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:39.923019 29787 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.777s I1031 23:07:39.923040 29787 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:40.655269 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:40.655323 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.527s I1031 23:07:40.655383 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:07:40.656003 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:07:40.656038 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:07:40.656224 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:07:40.656298 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:07:40.656316 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:40.656498 29792 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.385s I1031 23:07:40.656523 29792 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:42.583693 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:42.583746 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.526s I1031 23:07:42.583791 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:07:42.584301 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:07:42.584326 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:07:42.584578 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:07:42.584605 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:07:42.584620 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:42.585019 29803 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.346s I1031 23:07:42.585065 29803 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:45.600054 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:45.600107 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.904s I1031 23:07:45.600157 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:07:45.600649 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:07:45.600679 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:07:45.600899 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:07:45.600955 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:07:45.600975 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:45.601168 29813 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.680s I1031 23:07:45.601191 29813 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:48.790169 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:48.790222 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.229s I1031 23:07:48.790280 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:07:48.790746 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:07:48.790786 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:07:48.791015 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:07:48.791067 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:07:48.791087 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:48.791507 29836 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.779s I1031 23:07:48.791529 29836 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:51.070185 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:51.070248 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.562s I1031 23:07:51.070297 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:07:51.070857 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:07:51.070879 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:07:51.071151 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:07:51.071192 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:07:51.071203 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:51.071398 29839 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.700s I1031 23:07:51.071429 29839 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:53.006954 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:53.007005 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.347s I1031 23:07:53.007064 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:07:53.007633 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:07:53.007660 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:07:53.007947 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:07:53.007977 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:07:53.007990 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:53.008198 29843 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.986s I1031 23:07:53.008237 29843 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:53.765446 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:53.765491 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.145s I1031 23:07:53.765538 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:07:53.766017 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:07:53.766043 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:07:53.766201 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:07:53.766360 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:07:53.766382 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:53.766618 29851 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.854s I1031 23:07:53.766639 29851 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:57.971295 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:57.971357 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.327s I1031 23:07:57.971410 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:07:57.971925 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:07:57.971947 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:07:57.972157 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:07:57.972218 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:07:57.972239 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:57.972612 29882 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.080s I1031 23:07:57.972641 29882 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:58.316041 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:58.324527 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:58.371273 32806 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:58.378712 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:58.396216 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:58.417587 32806 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:58.431236 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:58.445010 32806 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:07:59.087640 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:59.087687 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.805s I1031 23:07:59.087748 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:07:59.088276 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:07:59.088304 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:07:59.088486 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:07:59.088555 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:07:59.088574 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:59.088809 29885 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.650s I1031 23:07:59.088830 29885 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:07:59.361027 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:07:59.361084 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.779s I1031 23:07:59.361140 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:07:59.361593 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:07:59.361627 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:07:59.361794 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:07:59.361870 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:07:59.361891 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:07:59.362185 29887 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.423s I1031 23:07:59.362206 29887 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:01.608404 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:01.608458 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.787s I1031 23:08:01.608511 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:08:01.608961 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:08:01.609011 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:08:01.609243 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:08:01.609271 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:08:01.609293 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:01.609491 29900 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.510s I1031 23:08:01.609516 29900 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:03.236652 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:03.236703 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.412s I1031 23:08:03.236762 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:08:03.237257 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:08:03.237293 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:08:03.237542 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:08:03.237577 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:08:03.237597 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:03.237797 29906 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.081s I1031 23:08:03.237824 29906 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:06.062835 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:06.062875 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.220s I1031 23:08:06.062922 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:08:06.063441 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:08:06.063477 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:08:06.063674 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:08:06.063724 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:08:06.063755 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:06.063946 29915 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.941s I1031 23:08:06.063984 29915 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:06.506296 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:06.506322 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.675s I1031 23:08:06.506364 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:08:06.506834 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:08:06.506865 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:08:06.507104 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:08:06.507153 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:08:06.507170 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:06.507380 29919 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.304s I1031 23:08:06.507400 29919 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:11.374019 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:11.374086 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.551s I1031 23:08:11.374145 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:08:11.374696 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:08:11.374723 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:08:11.374999 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:08:11.375066 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:08:11.375079 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:11.375214 29947 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.082s I1031 23:08:11.375234 29947 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:11.445770 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:11.445796 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.419s I1031 23:08:11.445837 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:08:11.446281 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:08:11.446307 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:08:11.446576 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:08:11.446632 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:08:11.446653 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:11.447090 29948 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.887s I1031 23:08:11.447110 29948 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:11.852527 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:11.852577 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.028s I1031 23:08:11.852638 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:08:11.853221 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:08:11.853250 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:08:11.853412 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:08:11.853534 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:08:11.853556 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:11.853796 29951 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.229s I1031 23:08:11.853816 29951 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:15.333154 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:15.333197 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.930s I1031 23:08:15.333258 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:08:15.333756 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:08:15.333784 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:08:15.334028 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:08:15.334081 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:08:15.334101 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:15.334229 29965 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.520s I1031 23:08:15.334250 29965 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:16.980850 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:16.980882 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.085s I1031 23:08:16.980929 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:08:16.981443 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:08:16.981469 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:08:16.981696 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:08:16.981740 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:08:16.981760 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:16.981948 29971 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.347s I1031 23:08:16.981974 29971 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:25.592655 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:25.592696 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.008s I1031 23:08:25.592753 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:08:25.593261 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:08:25.593289 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:08:25.593540 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:08:25.593638 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:08:25.593668 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:25.593845 30020 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.956s I1031 23:08:25.593866 30020 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:26.619529 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:26.619559 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.971s I1031 23:08:26.619608 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:08:26.620064 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:08:26.620092 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:08:26.620333 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:08:26.620473 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:08:26.620494 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:26.620679 30032 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.493s I1031 23:08:26.620703 30032 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:27.805655 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:27.805698 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.227s I1031 23:08:27.805763 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:08:27.806332 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:08:27.806360 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:08:27.806579 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:08:27.806627 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:08:27.806644 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:27.806825 30044 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.690s I1031 23:08:27.806845 30044 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:28.326028 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:28.345651 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:28.364770 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:28.371292 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:28.402824 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:28.412293 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:28.417809 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:28.452435 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:30.056608 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:30.056663 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.106s I1031 23:08:30.056723 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:08:30.057215 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:08:30.057243 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:08:30.057427 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:08:30.057499 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:08:30.057524 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:30.057662 30245 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.975s I1031 23:08:30.057683 30245 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:32.684161 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:32.684206 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.487s I1031 23:08:32.684262 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:08:32.684757 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:08:32.684785 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:08:32.685016 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:08:32.685091 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:08:32.685111 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:32.685236 30252 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.227s I1031 23:08:32.685259 30252 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:33.828742 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:33.828791 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.599s I1031 23:08:33.828864 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:08:33.829484 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:08:33.829514 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:08:33.829752 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:08:33.829871 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:08:33.829893 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:33.830150 30258 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.299s I1031 23:08:33.830171 30258 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:38.335526 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:38.335572 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.191s I1031 23:08:38.335640 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:08:38.336256 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:08:38.336295 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:08:38.336535 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:08:38.336575 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:08:38.336592 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:38.337049 30298 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.906s I1031 23:08:38.337079 30298 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:40.864516 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:40.864558 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.420s I1031 23:08:40.864611 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:08:40.865124 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:08:40.865152 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:08:40.865396 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:08:40.865473 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:08:40.865494 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:40.865679 30305 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.313s I1031 23:08:40.865700 30305 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:42.582043 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:42.582078 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.364s I1031 23:08:42.582134 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:08:42.582660 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:08:42.582698 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:08:42.582937 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:08:42.582981 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:08:42.583007 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:42.583214 30312 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.091s I1031 23:08:42.583240 30312 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:43.441054 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:43.441107 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.005s I1031 23:08:43.441176 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:08:43.441781 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:08:43.441812 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:08:43.441972 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:08:43.442057 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:08:43.442071 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:43.442705 30317 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.793s I1031 23:08:43.442723 30317 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:45.893482 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:45.893532 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.103s I1031 23:08:45.893596 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:08:45.894215 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:08:45.894254 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:08:45.894507 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:08:45.894538 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:08:45.894552 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:45.895208 30327 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.051s I1031 23:08:45.895233 30327 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:50.523931 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:50.523974 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.093s I1031 23:08:50.524042 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:08:50.524538 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:08:50.524564 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:08:50.524830 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:08:50.524876 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:08:50.524890 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:50.525540 30354 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.966s I1031 23:08:50.525588 30354 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:55.260248 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:55.260295 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.802s I1031 23:08:55.260360 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:08:55.260854 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:08:55.260890 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:08:55.261085 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:08:55.261201 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:08:55.261224 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:55.261348 30366 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.218s I1031 23:08:55.261368 30366 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:57.175037 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:08:57.175086 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.897s I1031 23:08:57.175135 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:08:57.175624 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:08:57.175657 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:08:57.175904 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:08:57.175942 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:08:57.175963 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:08:57.176527 30378 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.068s I1031 23:08:57.176550 30378 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:08:58.327093 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:58.354693 32806 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:58.406608 32806 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:58.412089 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:58.415555 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:58.462738 32806 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:58.464514 32806 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:08:58.474948 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:01.166239 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:01.166286 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.890s I1031 23:09:01.166344 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:09:01.167008 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:09:01.167037 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:09:01.167417 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:09:01.167500 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:09:01.167533 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:01.167868 30422 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.015s I1031 23:09:01.167889 30422 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:02.720162 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:02.720214 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.951s I1031 23:09:02.720263 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:09:02.720773 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:09:02.720798 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:09:02.721009 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:09:02.721045 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:09:02.721062 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:02.721614 30435 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.070s I1031 23:09:02.721643 30435 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:03.316812 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:03.316846 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.423s I1031 23:09:03.316882 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:03.317325 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:09:03.317348 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:09:03.317569 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:09:03.317705 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:09:03.317737 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:03.318294 30436 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.219s I1031 23:09:03.318315 30436 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:04.681407 27538 ts_tablet_manager.cc:755] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 311.905s user 0.000s sys 0.001s W1031 23:09:04.681428 27538 ts_tablet_manager.cc:785] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241: Tablet startup took 311905ms W1031 23:09:04.681543 27538 ts_tablet_manager.cc:787] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241: Trace: 1031 23:03:52.450676 (+ 0us) service_pool.cc:143] Inserting onto call queue 1031 23:03:52.450685 (+ 9us) service_pool.cc:202] Handling call 1031 23:03:52.450745 (+ 60us) ts_tablet_manager.cc:275] Acquired tablet manager lock 1031 23:03:52.450747 (+ 2us) ts_tablet_manager.cc:288] Creating new metadata... 1031 23:03:52.759771 (+309024us) tablet_metadata.cc:461] Metadata flushed 1031 23:03:52.760529 (+ 758us) inbound_call.cc:130] Queueing success response 1031 23:03:52.760559 (+ 30us) ts_tablet_manager.cc:724] Bootstrapping tablet 1031 23:03:52.776249 (+ 15690us) ts_tablet_manager.cc:756] Initializing tablet peer 1031 23:03:52.776265 (+ 16us) tablet_peer.cc:161] Creating consensus instance 1031 23:03:52.776563 (+ 298us) tablet_peer.cc:183] Starting instrumentation 1031 23:03:52.776566 (+ 3us) tablet_peer.cc:188] TabletPeer::Init() finished 1031 23:03:52.776567 (+ 1us) ts_tablet_manager.cc:771] Starting tablet peer 1031 23:03:52.776567 (+ 0us) tablet_peer.cc:195] Starting consensus Metrics: {"fdatasync":1,"fdatasync_us":257985,"mutex_wait_us":311904175,"raft.queue_time_us":322,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"tablet-open.queue_time_us":414,"thread_start_us":844,"threads_started":3} I1031 23:09:04.681577 27538 ts_tablet_manager.cc:723] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.681628 27553 ts_tablet_manager.cc:755] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 311.844s user 0.001s sys 0.000s W1031 23:09:04.681646 27553 ts_tablet_manager.cc:785] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241: Tablet startup took 311843ms W1031 23:09:04.681733 27553 ts_tablet_manager.cc:787] T 6f911a94e20d47aa9efaf9ffe3914c3b P 23f962e4a1744381ad5fa0d2d8b10241: Trace: 1031 23:03:52.449615 (+ 0us) service_pool.cc:143] Inserting onto call queue 1031 23:03:52.449627 (+ 12us) service_pool.cc:202] Handling call 1031 23:03:52.449748 (+ 121us) ts_tablet_manager.cc:275] Acquired tablet manager lock 1031 23:03:52.449752 (+ 4us) ts_tablet_manager.cc:288] Creating new metadata... 1031 23:03:52.835429 (+385677us) tablet_metadata.cc:461] Metadata flushed 1031 23:03:52.836174 (+ 745us) inbound_call.cc:130] Queueing success response 1031 23:03:52.836214 (+ 40us) ts_tablet_manager.cc:724] Bootstrapping tablet 1031 23:03:52.837736 (+ 1522us) ts_tablet_manager.cc:756] Initializing tablet peer 1031 23:03:52.837751 (+ 15us) tablet_peer.cc:161] Creating consensus instance 1031 23:03:52.838015 (+ 264us) tablet_peer.cc:183] Starting instrumentation 1031 23:03:52.838018 (+ 3us) tablet_peer.cc:188] TabletPeer::Init() finished 1031 23:03:52.838018 (+ 0us) ts_tablet_manager.cc:771] Starting tablet peer 1031 23:03:52.838018 (+ 0us) tablet_peer.cc:195] Starting consensus Metrics: {"fdatasync":1,"fdatasync_us":258507,"mutex_wait_us":311842801,"raft.queue_time_us":337,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"tablet-open.queue_time_us":318,"thread_start_us":930,"threads_started":3} I1031 23:09:04.681761 27553 ts_tablet_manager.cc:723] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.682138 27563 ts_tablet_manager.cc:755] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 311.794s user 0.000s sys 0.000s W1031 23:09:04.682155 27563 ts_tablet_manager.cc:785] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241: Tablet startup took 311794ms I1031 23:09:04.682241 27553 tablet_bootstrap.cc:382] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. W1031 23:09:04.682255 27563 ts_tablet_manager.cc:787] T e53178c96c3c4ad2b3068e9674d1259d P 23f962e4a1744381ad5fa0d2d8b10241: Trace: 1031 23:03:52.450692 (+ 0us) service_pool.cc:143] Inserting onto call queue 1031 23:03:52.450708 (+ 16us) service_pool.cc:202] Handling call 1031 23:03:52.450772 (+ 64us) ts_tablet_manager.cc:275] Acquired tablet manager lock 1031 23:03:52.450774 (+ 2us) ts_tablet_manager.cc:288] Creating new metadata... 1031 23:03:52.886003 (+435229us) tablet_metadata.cc:461] Metadata flushed 1031 23:03:52.886769 (+ 766us) inbound_call.cc:130] Queueing success response 1031 23:03:52.886801 (+ 32us) ts_tablet_manager.cc:724] Bootstrapping tablet 1031 23:03:52.888138 (+ 1337us) ts_tablet_manager.cc:756] Initializing tablet peer 1031 23:03:52.888154 (+ 16us) tablet_peer.cc:161] Creating consensus instance 1031 23:03:52.888397 (+ 243us) tablet_peer.cc:183] Starting instrumentation 1031 23:03:52.888401 (+ 4us) tablet_peer.cc:188] TabletPeer::Init() finished 1031 23:03:52.888401 (+ 0us) ts_tablet_manager.cc:771] Starting tablet peer 1031 23:03:52.888401 (+ 0us) tablet_peer.cc:195] Starting consensus Metrics: {"fdatasync":1,"fdatasync_us":257984,"mutex_wait_us":311793105,"raft.queue_time_us":114,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"tablet-open.queue_time_us":352,"thread_start_us":781,"threads_started":3} I1031 23:09:04.682283 27563 ts_tablet_manager.cc:723] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.682341 27568 ts_tablet_manager.cc:755] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 311.769s user 0.000s sys 0.000s W1031 23:09:04.682377 27568 ts_tablet_manager.cc:785] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241: Tablet startup took 311769ms I1031 23:09:04.682392 27553 tablet_bootstrap.cc:541] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.682397 27548 ts_tablet_manager.cc:755] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 311.870s user 0.000s sys 0.001s W1031 23:09:04.682420 27548 ts_tablet_manager.cc:785] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241: Tablet startup took 311869ms W1031 23:09:04.682502 27568 ts_tablet_manager.cc:787] T 31d6227f03a240c0977a072c02773b7a P 23f962e4a1744381ad5fa0d2d8b10241: Trace: 1031 23:03:52.449629 (+ 0us) service_pool.cc:143] Inserting onto call queue 1031 23:03:52.449668 (+ 39us) service_pool.cc:202] Handling call 1031 23:03:52.449774 (+ 106us) ts_tablet_manager.cc:275] Acquired tablet manager lock 1031 23:03:52.449777 (+ 3us) ts_tablet_manager.cc:288] Creating new metadata... 1031 23:03:52.911282 (+461505us) tablet_metadata.cc:461] Metadata flushed 1031 23:03:52.911899 (+ 617us) inbound_call.cc:130] Queueing success response 1031 23:03:52.911927 (+ 28us) ts_tablet_manager.cc:724] Bootstrapping tablet 1031 23:03:52.913152 (+ 1225us) ts_tablet_manager.cc:756] Initializing tablet peer 1031 23:03:52.913167 (+ 15us) tablet_peer.cc:161] Creating consensus instance 1031 23:03:52.913417 (+ 250us) tablet_peer.cc:183] Starting instrumentation 1031 23:03:52.913420 (+ 3us) tablet_peer.cc:188] TabletPeer::Init() finished 1031 23:03:52.913421 (+ 1us) ts_tablet_manager.cc:771] Starting tablet peer 1031 23:03:52.913421 (+ 0us) tablet_peer.cc:195] Starting consensus Metrics: {"fdatasync":1,"fdatasync_us":258895,"mutex_wait_us":311768459,"raft.queue_time_us":100,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"tablet-open.queue_time_us":155,"thread_start_us":418,"threads_started":3} I1031 23:09:04.682507 27543 ts_tablet_manager.cc:755] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 311.896s user 0.001s sys 0.001s I1031 23:09:04.682530 27533 ts_tablet_manager.cc:755] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 311.946s user 0.000s sys 0.001s W1031 23:09:04.682539 27543 ts_tablet_manager.cc:785] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241: Tablet startup took 311895ms W1031 23:09:04.682554 27533 ts_tablet_manager.cc:785] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241: Tablet startup took 311945ms I1031 23:09:04.682540 27553 tablet_bootstrap.cc:484] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.682536 27568 ts_tablet_manager.cc:723] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.682453 27558 ts_tablet_manager.cc:755] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 311.819s user 0.000s sys 0.001s W1031 23:09:04.682607 27558 ts_tablet_manager.cc:785] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241: Tablet startup took 311819ms W1031 23:09:04.682641 27548 ts_tablet_manager.cc:787] T 6ca74226a6af40e2a78046fc3591c038 P 23f962e4a1744381ad5fa0d2d8b10241: Trace: 1031 23:03:52.450631 (+ 0us) service_pool.cc:143] Inserting onto call queue 1031 23:03:52.450663 (+ 32us) service_pool.cc:202] Handling call 1031 23:03:52.450740 (+ 77us) ts_tablet_manager.cc:275] Acquired tablet manager lock 1031 23:03:52.450743 (+ 3us) ts_tablet_manager.cc:288] Creating new metadata... 1031 23:03:52.810158 (+359415us) tablet_metadata.cc:461] Metadata flushed 1031 23:03:52.810865 (+ 707us) inbound_call.cc:130] Queueing success response 1031 23:03:52.810906 (+ 41us) ts_tablet_manager.cc:724] Bootstrapping tablet 1031 23:03:52.812538 (+ 1632us) ts_tablet_manager.cc:756] Initializing tablet peer 1031 23:03:52.812554 (+ 16us) tablet_peer.cc:161] Creating consensus instance 1031 23:03:52.812845 (+ 291us) tablet_peer.cc:183] Starting instrumentation 1031 23:03:52.812848 (+ 3us) tablet_peer.cc:188] TabletPeer::Init() finished 1031 23:03:52.812848 (+ 0us) ts_tablet_manager.cc:771] Starting tablet peer 1031 23:03:52.812848 (+ 0us) tablet_peer.cc:195] Starting consensus Metrics: {"fdatasync":1,"fdatasync_us":257908,"mutex_wait_us":311868747,"raft.queue_time_us":304,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"tablet-open.queue_time_us":295,"thread_start_us":883,"threads_started":3} I1031 23:09:04.682682 27548 ts_tablet_manager.cc:723] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.682708 27563 tablet_bootstrap.cc:382] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. W1031 23:09:04.682721 27543 ts_tablet_manager.cc:787] T 9967925d5dbd49eaadc0a1a58e7e2089 P 23f962e4a1744381ad5fa0d2d8b10241: Trace: 1031 23:03:52.450647 (+ 0us) service_pool.cc:143] Inserting onto call queue 1031 23:03:52.450657 (+ 10us) service_pool.cc:202] Handling call 1031 23:03:52.450708 (+ 51us) ts_tablet_manager.cc:275] Acquired tablet manager lock 1031 23:03:52.450711 (+ 3us) ts_tablet_manager.cc:288] Creating new metadata... 1031 23:03:52.784966 (+334255us) tablet_metadata.cc:461] Metadata flushed 1031 23:03:52.785696 (+ 730us) inbound_call.cc:130] Queueing success response 1031 23:03:52.785753 (+ 57us) ts_tablet_manager.cc:724] Bootstrapping tablet 1031 23:03:52.786920 (+ 1167us) ts_tablet_manager.cc:756] Initializing tablet peer 1031 23:03:52.786936 (+ 16us) tablet_peer.cc:161] Creating consensus instance 1031 23:03:52.787201 (+ 265us) tablet_peer.cc:183] Starting instrumentation 1031 23:03:52.787204 (+ 3us) tablet_peer.cc:188] TabletPeer::Init() finished 1031 23:03:52.787204 (+ 0us) ts_tablet_manager.cc:771] Starting tablet peer 1031 23:03:52.787205 (+ 1us) tablet_peer.cc:195] Starting consensus Metrics: {"fdatasync":1,"fdatasync_us":257980,"mutex_wait_us":311894480,"raft.queue_time_us":299,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"tablet-open.queue_time_us":332,"thread_start_us":927,"threads_started":3} W1031 23:09:04.682724 27533 ts_tablet_manager.cc:787] T de45d05c3a064dc5acb91d66dcaea6ed P 23f962e4a1744381ad5fa0d2d8b10241: Trace: 1031 23:03:52.451308 (+ 0us) service_pool.cc:143] Inserting onto call queue 1031 23:03:52.451328 (+ 20us) service_pool.cc:202] Handling call 1031 23:03:52.451408 (+ 80us) ts_tablet_manager.cc:275] Acquired tablet manager lock 1031 23:03:52.451411 (+ 3us) ts_tablet_manager.cc:288] Creating new metadata... 1031 23:03:52.734592 (+283181us) tablet_metadata.cc:461] Metadata flushed 1031 23:03:52.735213 (+ 621us) inbound_call.cc:130] Queueing success response 1031 23:03:52.735252 (+ 39us) ts_tablet_manager.cc:724] Bootstrapping tablet 1031 23:03:52.736662 (+ 1410us) ts_tablet_manager.cc:756] Initializing tablet peer 1031 23:03:52.736679 (+ 17us) tablet_peer.cc:161] Creating consensus instance 1031 23:03:52.736955 (+ 276us) tablet_peer.cc:183] Starting instrumentation 1031 23:03:52.736959 (+ 4us) tablet_peer.cc:188] TabletPeer::Init() finished 1031 23:03:52.736959 (+ 0us) ts_tablet_manager.cc:771] Starting tablet peer 1031 23:03:52.736960 (+ 1us) tablet_peer.cc:195] Starting consensus Metrics: {"fdatasync":1,"fdatasync_us":257143,"mutex_wait_us":311944968,"raft.queue_time_us":171,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"tablet-open.queue_time_us":232,"thread_start_us":578,"threads_started":3} W1031 23:09:04.682735 27558 ts_tablet_manager.cc:787] T 090accc17fae4e60b7bddb6dd0bf2ef8 P 23f962e4a1744381ad5fa0d2d8b10241: Trace: 1031 23:03:52.451328 (+ 0us) service_pool.cc:143] Inserting onto call queue 1031 23:03:52.451337 (+ 9us) service_pool.cc:202] Handling call 1031 23:03:52.451412 (+ 75us) ts_tablet_manager.cc:275] Acquired tablet manager lock 1031 23:03:52.451415 (+ 3us) ts_tablet_manager.cc:288] Creating new metadata... 1031 23:03:52.860718 (+409303us) tablet_metadata.cc:461] Metadata flushed 1031 23:03:52.861526 (+ 808us) inbound_call.cc:130] Queueing success response 1031 23:03:52.861563 (+ 37us) ts_tablet_manager.cc:724] Bootstrapping tablet 1031 23:03:52.863130 (+ 1567us) ts_tablet_manager.cc:756] Initializing tablet peer 1031 23:03:52.863146 (+ 16us) tablet_peer.cc:161] Creating consensus instance 1031 23:03:52.863432 (+ 286us) tablet_peer.cc:183] Starting instrumentation 1031 23:03:52.863436 (+ 4us) tablet_peer.cc:188] TabletPeer::Init() finished 1031 23:03:52.863436 (+ 0us) ts_tablet_manager.cc:771] Starting tablet peer 1031 23:03:52.863436 (+ 0us) tablet_peer.cc:195] Starting consensus Metrics: {"fdatasync":1,"fdatasync_us":257232,"mutex_wait_us":311818214,"raft.queue_time_us":275,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"tablet-open.queue_time_us":363,"thread_start_us":963,"threads_started":3} I1031 23:09:04.682751 27543 ts_tablet_manager.cc:723] T 68aa6071fa594e79958cddb8489a1f0c P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.682763 27533 ts_tablet_manager.cc:723] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.682775 27558 ts_tablet_manager.cc:723] T 42d56cd12bbb4bed9973f96a230fdb9e P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.682864 27538 tablet_bootstrap.cc:382] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.682896 32760 tablet.cc:911] T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering stage 1 (old memrowset already frozen for inserts) I1031 23:09:04.682920 32760 compaction.cc:877] Selected 1 rowsets to compact: I1031 23:09:04.682940 32760 compaction.cc:880] memrowset(current size on disk: ~0 bytes) I1031 23:09:04.682952 32760 tablet.cc:913] T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Memstore in-memory size: 1019671 bytes I1031 23:09:04.682955 27563 tablet_bootstrap.cc:541] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.682968 32760 tablet.cc:1174] T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6182758582111772672 or (T in {6182758582111772672})}] I1031 23:09:04.682986 27538 tablet_bootstrap.cc:541] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.683091 27563 tablet_bootstrap.cc:484] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.683112 32760 multi_column_writer.cc:85] Opened CFile writer for column olap_date[int32 NOT NULL] I1031 23:09:04.683141 27538 tablet_bootstrap.cc:484] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.683146 27568 tablet_bootstrap.cc:382] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.683162 27548 tablet_bootstrap.cc:382] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.683171 27533 tablet_bootstrap.cc:382] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.683181 32760 multi_column_writer.cc:85] Opened CFile writer for column timestamp[int64 NOT NULL] I1031 23:09:04.683197 27543 tablet_bootstrap.cc:382] T 68aa6071fa594e79958cddb8489a1f0c P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.683200 27558 tablet_bootstrap.cc:382] T 42d56cd12bbb4bed9973f96a230fdb9e P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.683271 32760 multi_column_writer.cc:85] Opened CFile writer for column tweet_id[int64 NOT NULL] I1031 23:09:04.683323 27558 tablet_bootstrap.cc:541] T 42d56cd12bbb4bed9973f96a230fdb9e P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.683331 32760 multi_column_writer.cc:85] Opened CFile writer for column created_at[string NULLABLE] I1031 23:09:04.683326 27533 tablet_bootstrap.cc:541] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.683374 32760 multi_column_writer.cc:85] Opened CFile writer for column text[string NULLABLE] I1031 23:09:04.683413 32760 multi_column_writer.cc:85] Opened CFile writer for column source[string NULLABLE] I1031 23:09:04.683447 32760 multi_column_writer.cc:85] Opened CFile writer for column user_id[int64 NULLABLE] I1031 23:09:04.683449 27558 tablet_bootstrap.cc:484] T 42d56cd12bbb4bed9973f96a230fdb9e P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.683487 32760 multi_column_writer.cc:85] Opened CFile writer for column user_name[string NULLABLE] I1031 23:09:04.683493 27533 tablet_bootstrap.cc:484] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.683518 32760 multi_column_writer.cc:85] Opened CFile writer for column user_location[string NULLABLE] I1031 23:09:04.683576 32760 multi_column_writer.cc:85] Opened CFile writer for column user_followers_count[int32 NULLABLE] I1031 23:09:04.683635 32760 multi_column_writer.cc:85] Opened CFile writer for column user_friends_count[int32 NULLABLE] I1031 23:09:04.683663 27543 tablet_bootstrap.cc:541] T 68aa6071fa594e79958cddb8489a1f0c P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.683676 27568 tablet_bootstrap.cc:541] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.683676 27548 tablet_bootstrap.cc:541] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.683758 27543 tablet_bootstrap.cc:484] T 68aa6071fa594e79958cddb8489a1f0c P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.683859 27568 tablet_bootstrap.cc:484] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.683921 27548 tablet_bootstrap.cc:484] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.698933 27553 tablet_bootstrap.cc:382] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.698961 27553 ts_tablet_manager.cc:728] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s I1031 23:09:04.699658 27553 raft_consensus.cc:288] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } I1031 23:09:04.699678 27553 raft_consensus.cc:319] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.699687 27553 raft_consensus.cc:548] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.699700 27553 consensus_queue.cc:176] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.700074 27553 ts_tablet_manager.cc:755] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s I1031 23:09:04.700160 27553 ts_tablet_manager.cc:723] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.700366 27553 tablet_bootstrap.cc:382] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.700474 27553 tablet_bootstrap.cc:541] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.700557 27553 tablet_bootstrap.cc:484] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.708617 27538 tablet_bootstrap.cc:382] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.708642 27563 tablet_bootstrap.cc:382] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.708647 27538 ts_tablet_manager.cc:728] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.001s I1031 23:09:04.708678 27563 ts_tablet_manager.cc:728] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s I1031 23:09:04.708714 27548 tablet_bootstrap.cc:382] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.708750 27533 tablet_bootstrap.cc:382] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.708751 27548 ts_tablet_manager.cc:728] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.001s I1031 23:09:04.708755 27558 tablet_bootstrap.cc:382] T 42d56cd12bbb4bed9973f96a230fdb9e P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.708784 27533 ts_tablet_manager.cc:728] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.000s I1031 23:09:04.708791 27558 ts_tablet_manager.cc:728] T 42d56cd12bbb4bed9973f96a230fdb9e P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.000s I1031 23:09:04.709095 27543 tablet_bootstrap.cc:382] T 68aa6071fa594e79958cddb8489a1f0c P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.709120 27543 ts_tablet_manager.cc:728] T 68aa6071fa594e79958cddb8489a1f0c P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.000s I1031 23:09:04.710170 27568 tablet_bootstrap.cc:382] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.710180 27553 tablet_bootstrap.cc:382] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.710194 27568 ts_tablet_manager.cc:728] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.001s I1031 23:09:04.710213 27553 ts_tablet_manager.cc:728] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s I1031 23:09:04.710937 27558 raft_consensus.cc:288] T 42d56cd12bbb4bed9973f96a230fdb9e P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "0f53a0d3ef7e44ebb0365c800752d5bd" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st01.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:04.710969 27558 raft_consensus.cc:319] T 42d56cd12bbb4bed9973f96a230fdb9e P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.710981 27558 raft_consensus.cc:548] T 42d56cd12bbb4bed9973f96a230fdb9e P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.710999 27558 consensus_queue.cc:176] T 42d56cd12bbb4bed9973f96a230fdb9e P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.711017 27533 raft_consensus.cc:288] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:04.711037 27533 raft_consensus.cc:319] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.711045 27533 raft_consensus.cc:548] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.711061 27533 consensus_queue.cc:176] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.711096 27543 raft_consensus.cc:288] T 68aa6071fa594e79958cddb8489a1f0c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } I1031 23:09:04.711118 27543 raft_consensus.cc:319] T 68aa6071fa594e79958cddb8489a1f0c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.711128 27543 raft_consensus.cc:548] T 68aa6071fa594e79958cddb8489a1f0c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.711143 27543 consensus_queue.cc:176] T 68aa6071fa594e79958cddb8489a1f0c P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.711194 27538 raft_consensus.cc:288] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } I1031 23:09:04.711216 27538 raft_consensus.cc:319] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.711210 27563 raft_consensus.cc:288] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:04.711230 27538 raft_consensus.cc:548] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.711252 27563 raft_consensus.cc:319] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.711256 27538 consensus_queue.cc:176] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.711272 27563 raft_consensus.cc:548] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.711289 27563 consensus_queue.cc:176] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.711367 27548 raft_consensus.cc:288] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } I1031 23:09:04.711386 27548 raft_consensus.cc:319] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.711393 27548 raft_consensus.cc:548] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.711406 27548 consensus_queue.cc:176] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.713030 27553 raft_consensus.cc:288] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } I1031 23:09:04.713052 27553 raft_consensus.cc:319] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.713064 27553 raft_consensus.cc:548] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.713078 27553 consensus_queue.cc:176] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.713100 27568 raft_consensus.cc:288] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:04.713116 27568 raft_consensus.cc:319] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.713126 27568 raft_consensus.cc:548] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.713143 27568 consensus_queue.cc:176] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.713158 27558 ts_tablet_manager.cc:755] T 42d56cd12bbb4bed9973f96a230fdb9e P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s I1031 23:09:04.713188 27558 ts_tablet_manager.cc:723] T fcde65c4e4cf4df29b9ef9884ce292b2 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.713435 27558 tablet_bootstrap.cc:382] T fcde65c4e4cf4df29b9ef9884ce292b2 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.713558 27558 tablet_bootstrap.cc:541] T fcde65c4e4cf4df29b9ef9884ce292b2 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.713654 27558 tablet_bootstrap.cc:484] T fcde65c4e4cf4df29b9ef9884ce292b2 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.714000 27543 ts_tablet_manager.cc:755] T 68aa6071fa594e79958cddb8489a1f0c P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s I1031 23:09:04.714033 27543 ts_tablet_manager.cc:723] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.714064 27563 ts_tablet_manager.cc:755] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s I1031 23:09:04.714143 27538 ts_tablet_manager.cc:755] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s I1031 23:09:04.714159 27563 ts_tablet_manager.cc:723] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.714236 27538 ts_tablet_manager.cc:723] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.714306 27543 tablet_bootstrap.cc:382] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.714413 27543 tablet_bootstrap.cc:541] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.714490 27563 tablet_bootstrap.cc:382] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.714505 27543 tablet_bootstrap.cc:484] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.714532 27538 tablet_bootstrap.cc:382] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.714582 32806 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.714603 32806 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: 27f651ff46ca4722b064a85e795dcaa4 I1031 23:09:04.714630 27533 ts_tablet_manager.cc:755] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s I1031 23:09:04.714640 27563 tablet_bootstrap.cc:541] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.714640 32806 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(27f651ff46ca4722b064a85e795dcaa4) I1031 23:09:04.714653 27538 tablet_bootstrap.cc:541] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.714665 27533 ts_tablet_manager.cc:723] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.714675 32806 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(27f651ff46ca4722b064a85e795dcaa4) I1031 23:09:04.714728 27548 ts_tablet_manager.cc:755] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s I1031 23:09:04.714732 32806 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(27f651ff46ca4722b064a85e795dcaa4) I1031 23:09:04.714757 32806 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(27f651ff46ca4722b064a85e795dcaa4) I1031 23:09:04.714761 27548 ts_tablet_manager.cc:723] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.714776 27538 tablet_bootstrap.cc:484] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.714785 32806 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(27f651ff46ca4722b064a85e795dcaa4) I1031 23:09:04.714803 32806 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(27f651ff46ca4722b064a85e795dcaa4) I1031 23:09:04.714810 27563 tablet_bootstrap.cc:484] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.714823 32806 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(27f651ff46ca4722b064a85e795dcaa4) I1031 23:09:04.714838 32806 raft_consensus.cc:1569] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.714855 32806 raft_consensus.cc:1585] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.714885 27568 ts_tablet_manager.cc:755] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s I1031 23:09:04.714905 27553 ts_tablet_manager.cc:755] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s I1031 23:09:04.714918 27568 ts_tablet_manager.cc:723] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.714937 27553 ts_tablet_manager.cc:723] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.714973 27533 tablet_bootstrap.cc:382] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.715091 27533 tablet_bootstrap.cc:541] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.715163 27543 tablet_bootstrap.cc:382] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.715186 27533 tablet_bootstrap.cc:484] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.715195 27543 ts_tablet_manager.cc:728] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s I1031 23:09:04.715212 27548 tablet_bootstrap.cc:382] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.715226 27553 tablet_bootstrap.cc:382] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.715278 27568 tablet_bootstrap.cc:382] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.715373 27553 tablet_bootstrap.cc:541] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.715386 27548 tablet_bootstrap.cc:541] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.715411 27568 tablet_bootstrap.cc:541] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.715467 27553 tablet_bootstrap.cc:484] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.715577 27568 tablet_bootstrap.cc:484] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.715622 27548 tablet_bootstrap.cc:484] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.715847 27558 tablet_bootstrap.cc:382] T fcde65c4e4cf4df29b9ef9884ce292b2 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.715870 27558 ts_tablet_manager.cc:728] T fcde65c4e4cf4df29b9ef9884ce292b2 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s I1031 23:09:04.716286 27558 raft_consensus.cc:288] T fcde65c4e4cf4df29b9ef9884ce292b2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "0f53a0d3ef7e44ebb0365c800752d5bd" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st01.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:04.716303 27558 raft_consensus.cc:319] T fcde65c4e4cf4df29b9ef9884ce292b2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.716312 27558 raft_consensus.cc:548] T fcde65c4e4cf4df29b9ef9884ce292b2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.716325 27558 consensus_queue.cc:176] T fcde65c4e4cf4df29b9ef9884ce292b2 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.716428 32809 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.716430 32805 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.716457 32809 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: f49a4f915ac048b096fcb5f4878f436d I1031 23:09:04.716462 32805 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: f0a40a8745bb4f4abbe8b304ebc7626c I1031 23:09:04.716469 27558 ts_tablet_manager.cc:755] T fcde65c4e4cf4df29b9ef9884ce292b2 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I1031 23:09:04.716486 32809 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(f49a4f915ac048b096fcb5f4878f436d) I1031 23:09:04.716493 32805 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(f0a40a8745bb4f4abbe8b304ebc7626c) I1031 23:09:04.716500 27558 ts_tablet_manager.cc:723] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.716511 32809 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(f49a4f915ac048b096fcb5f4878f436d) I1031 23:09:04.716516 32805 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(f0a40a8745bb4f4abbe8b304ebc7626c) I1031 23:09:04.716536 32809 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(f49a4f915ac048b096fcb5f4878f436d) I1031 23:09:04.716542 32805 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(f0a40a8745bb4f4abbe8b304ebc7626c) I1031 23:09:04.716554 32809 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(f49a4f915ac048b096fcb5f4878f436d) I1031 23:09:04.716559 32805 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(f0a40a8745bb4f4abbe8b304ebc7626c) I1031 23:09:04.716583 32809 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(f49a4f915ac048b096fcb5f4878f436d) I1031 23:09:04.716588 32805 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(f0a40a8745bb4f4abbe8b304ebc7626c) I1031 23:09:04.716605 32809 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(f49a4f915ac048b096fcb5f4878f436d) I1031 23:09:04.716608 32805 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(f0a40a8745bb4f4abbe8b304ebc7626c) I1031 23:09:04.716626 32809 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(f49a4f915ac048b096fcb5f4878f436d) I1031 23:09:04.716629 32805 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(f0a40a8745bb4f4abbe8b304ebc7626c) I1031 23:09:04.716645 32809 raft_consensus.cc:1569] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.716648 32805 raft_consensus.cc:1569] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.716666 32809 raft_consensus.cc:1585] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.716670 32805 raft_consensus.cc:1585] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.716725 27558 tablet_bootstrap.cc:382] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.716792 32801 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.716814 32801 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: 5110f0095bd94f67abf0aad906332efe I1031 23:09:04.716831 32801 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(5110f0095bd94f67abf0aad906332efe) I1031 23:09:04.716842 27558 tablet_bootstrap.cc:541] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.716845 32801 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(5110f0095bd94f67abf0aad906332efe) I1031 23:09:04.716856 27533 tablet_bootstrap.cc:382] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.716859 32801 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(5110f0095bd94f67abf0aad906332efe) I1031 23:09:04.716886 27533 ts_tablet_manager.cc:728] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I1031 23:09:04.716889 32801 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(5110f0095bd94f67abf0aad906332efe) I1031 23:09:04.716909 32801 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(5110f0095bd94f67abf0aad906332efe) I1031 23:09:04.716920 32801 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(5110f0095bd94f67abf0aad906332efe) I1031 23:09:04.716931 32801 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(5110f0095bd94f67abf0aad906332efe) I1031 23:09:04.716938 27558 tablet_bootstrap.cc:484] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.716946 32801 raft_consensus.cc:1569] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.716956 32801 raft_consensus.cc:1585] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.716969 27543 raft_consensus.cc:288] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } I1031 23:09:04.716995 27543 raft_consensus.cc:319] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.717008 27543 raft_consensus.cc:548] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.717023 27543 consensus_queue.cc:176] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.717191 27538 tablet_bootstrap.cc:382] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.717216 27538 ts_tablet_manager.cc:728] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s I1031 23:09:04.717325 27533 raft_consensus.cc:288] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:04.717344 27533 raft_consensus.cc:319] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.717356 27533 raft_consensus.cc:548] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.717371 27533 consensus_queue.cc:176] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.718130 27553 tablet_bootstrap.cc:382] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.718140 27548 tablet_bootstrap.cc:382] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.718152 27553 ts_tablet_manager.cc:728] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s I1031 23:09:04.718173 27548 ts_tablet_manager.cc:728] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s I1031 23:09:04.718235 27538 raft_consensus.cc:288] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f53a0d3ef7e44ebb0365c800752d5bd" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st01.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:04.718252 27538 raft_consensus.cc:319] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.718262 27538 raft_consensus.cc:548] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.718276 27538 consensus_queue.cc:176] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.718304 27533 ts_tablet_manager.cc:755] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I1031 23:09:04.718413 27568 tablet_bootstrap.cc:382] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.718418 27563 tablet_bootstrap.cc:382] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.718443 27568 ts_tablet_manager.cc:728] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s I1031 23:09:04.718443 27563 ts_tablet_manager.cc:728] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s I1031 23:09:04.718505 27543 ts_tablet_manager.cc:755] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s I1031 23:09:04.718531 27538 ts_tablet_manager.cc:755] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s I1031 23:09:04.718665 27553 raft_consensus.cc:288] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:04.718688 27553 raft_consensus.cc:319] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.718695 27553 raft_consensus.cc:548] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.718709 27553 consensus_queue.cc:176] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.718755 27558 tablet_bootstrap.cc:382] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.718780 27558 ts_tablet_manager.cc:728] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s I1031 23:09:04.718801 32806 ts_tablet_manager.cc:1020] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.718868 27553 ts_tablet_manager.cc:755] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I1031 23:09:04.718955 27533 ts_tablet_manager.cc:723] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.718963 27553 ts_tablet_manager.cc:723] T 7d1359dc00a24df68d41c2447e367f1d P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.718979 27543 ts_tablet_manager.cc:723] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.719161 32802 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.719187 32802 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: 46fc46e028434bc69f467922a9a59101 I1031 23:09:04.719208 32802 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(46fc46e028434bc69f467922a9a59101) I1031 23:09:04.719226 32802 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(46fc46e028434bc69f467922a9a59101) I1031 23:09:04.719240 27548 raft_consensus.cc:288] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } I1031 23:09:04.719246 32802 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(46fc46e028434bc69f467922a9a59101) I1031 23:09:04.719269 27548 raft_consensus.cc:319] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.719257 27543 tablet_bootstrap.cc:382] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.719281 32802 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(46fc46e028434bc69f467922a9a59101) I1031 23:09:04.719285 27548 raft_consensus.cc:548] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.719287 27553 tablet_bootstrap.cc:382] T 7d1359dc00a24df68d41c2447e367f1d P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.719303 27548 consensus_queue.cc:176] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.719296 32802 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(46fc46e028434bc69f467922a9a59101) I1031 23:09:04.719322 27538 ts_tablet_manager.cc:723] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.719331 32802 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(46fc46e028434bc69f467922a9a59101) I1031 23:09:04.719342 32802 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(46fc46e028434bc69f467922a9a59101) I1031 23:09:04.719357 32802 raft_consensus.cc:1569] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.719374 32802 raft_consensus.cc:1585] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.719383 27543 tablet_bootstrap.cc:541] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.719431 27553 tablet_bootstrap.cc:541] T 7d1359dc00a24df68d41c2447e367f1d P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.719488 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.719501 27543 tablet_bootstrap.cc:484] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.719511 32815 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: 80ba7f33ec864c5f96c61932edb5cdc4 I1031 23:09:04.719519 32814 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.719532 32815 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(80ba7f33ec864c5f96c61932edb5cdc4) I1031 23:09:04.719539 32814 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: 0ea66c65e2d4445eb9cc83ba7ee1448b I1031 23:09:04.719550 32815 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(80ba7f33ec864c5f96c61932edb5cdc4) I1031 23:09:04.719558 32814 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(0ea66c65e2d4445eb9cc83ba7ee1448b) I1031 23:09:04.719569 32815 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(80ba7f33ec864c5f96c61932edb5cdc4) I1031 23:09:04.719571 27553 tablet_bootstrap.cc:484] T 7d1359dc00a24df68d41c2447e367f1d P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.719580 32814 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(0ea66c65e2d4445eb9cc83ba7ee1448b) I1031 23:09:04.719588 32815 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(80ba7f33ec864c5f96c61932edb5cdc4) I1031 23:09:04.719599 32814 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(0ea66c65e2d4445eb9cc83ba7ee1448b) I1031 23:09:04.719604 32815 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(80ba7f33ec864c5f96c61932edb5cdc4) I1031 23:09:04.719619 32814 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(0ea66c65e2d4445eb9cc83ba7ee1448b) I1031 23:09:04.719626 32815 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(80ba7f33ec864c5f96c61932edb5cdc4) I1031 23:09:04.719636 32814 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(0ea66c65e2d4445eb9cc83ba7ee1448b) I1031 23:09:04.719642 32815 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(80ba7f33ec864c5f96c61932edb5cdc4) I1031 23:09:04.719652 32814 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(0ea66c65e2d4445eb9cc83ba7ee1448b) I1031 23:09:04.719656 32815 raft_consensus.cc:1569] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.719668 32814 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(0ea66c65e2d4445eb9cc83ba7ee1448b) I1031 23:09:04.719671 27538 tablet_bootstrap.cc:382] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.719681 32814 raft_consensus.cc:1569] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.719672 32815 raft_consensus.cc:1585] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.719704 32814 raft_consensus.cc:1585] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.719810 27538 tablet_bootstrap.cc:541] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.719295 27533 tablet_bootstrap.cc:382] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.719931 27538 tablet_bootstrap.cc:484] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.720038 27533 tablet_bootstrap.cc:541] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.720137 27533 tablet_bootstrap.cc:484] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.720571 32809 ts_tablet_manager.cc:1020] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.720692 32805 ts_tablet_manager.cc:1020] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.720861 32801 ts_tablet_manager.cc:1020] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.720870 27558 raft_consensus.cc:288] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:09:04.720876 27563 raft_consensus.cc:288] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:09:04.720886 27558 raft_consensus.cc:319] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.720892 27563 raft_consensus.cc:319] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.720894 27558 raft_consensus.cc:548] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.720906 27563 raft_consensus.cc:548] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.720921 27558 consensus_queue.cc:176] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.720927 27563 consensus_queue.cc:176] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.721361 27568 raft_consensus.cc:288] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f53a0d3ef7e44ebb0365c800752d5bd" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st01.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:09:04.721384 27568 raft_consensus.cc:319] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.721397 27568 raft_consensus.cc:548] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.721397 27548 ts_tablet_manager.cc:755] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s I1031 23:09:04.721421 27568 consensus_queue.cc:176] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.721432 27548 ts_tablet_manager.cc:723] T db5874009dd84d4892fccdb3316010c2 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.721644 32817 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.721674 32817 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: b758ec3274c84dcbb110cf5aa3dca9aa I1031 23:09:04.721683 27548 tablet_bootstrap.cc:382] T db5874009dd84d4892fccdb3316010c2 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.721701 32817 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(b758ec3274c84dcbb110cf5aa3dca9aa) I1031 23:09:04.721725 32817 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(b758ec3274c84dcbb110cf5aa3dca9aa) I1031 23:09:04.721748 32817 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(b758ec3274c84dcbb110cf5aa3dca9aa) I1031 23:09:04.721771 32817 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(b758ec3274c84dcbb110cf5aa3dca9aa) I1031 23:09:04.721786 27548 tablet_bootstrap.cc:541] T db5874009dd84d4892fccdb3316010c2 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.721793 32817 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(b758ec3274c84dcbb110cf5aa3dca9aa) I1031 23:09:04.721815 32817 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(b758ec3274c84dcbb110cf5aa3dca9aa) I1031 23:09:04.721837 32817 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(b758ec3274c84dcbb110cf5aa3dca9aa) I1031 23:09:04.721860 32817 raft_consensus.cc:1569] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.721877 27548 tablet_bootstrap.cc:484] T db5874009dd84d4892fccdb3316010c2 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.721889 32817 raft_consensus.cc:1585] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.722149 27543 tablet_bootstrap.cc:382] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.722182 27543 ts_tablet_manager.cc:728] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s I1031 23:09:04.722187 27558 ts_tablet_manager.cc:755] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s I1031 23:09:04.722216 27558 ts_tablet_manager.cc:723] T 47eeb8448c454968a45bf1a984427b25 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.722285 27563 ts_tablet_manager.cc:755] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s I1031 23:09:04.722313 27563 ts_tablet_manager.cc:723] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.722324 27568 ts_tablet_manager.cc:755] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s I1031 23:09:04.722355 27568 ts_tablet_manager.cc:723] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.722376 27553 tablet_bootstrap.cc:382] T 7d1359dc00a24df68d41c2447e367f1d P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.722400 27553 ts_tablet_manager.cc:728] T 7d1359dc00a24df68d41c2447e367f1d P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s I1031 23:09:04.722400 32807 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.722447 27558 tablet_bootstrap.cc:382] T 47eeb8448c454968a45bf1a984427b25 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.722553 27558 tablet_bootstrap.cc:541] T 47eeb8448c454968a45bf1a984427b25 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.722570 27563 tablet_bootstrap.cc:382] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.722640 27558 tablet_bootstrap.cc:484] T 47eeb8448c454968a45bf1a984427b25 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.722646 27568 tablet_bootstrap.cc:382] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.722698 27563 tablet_bootstrap.cc:541] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.722726 27543 raft_consensus.cc:288] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } I1031 23:09:04.722748 27543 raft_consensus.cc:319] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.722754 27568 tablet_bootstrap.cc:541] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.722761 27543 raft_consensus.cc:548] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.722779 27543 consensus_queue.cc:176] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.722786 27563 tablet_bootstrap.cc:484] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.722827 32807 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: 005a48fb466c4a52896842dd00124755 I1031 23:09:04.722849 32807 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(005a48fb466c4a52896842dd00124755) I1031 23:09:04.722851 27568 tablet_bootstrap.cc:484] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.722862 27553 raft_consensus.cc:288] T 7d1359dc00a24df68d41c2447e367f1d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:09:04.722863 32807 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(005a48fb466c4a52896842dd00124755) I1031 23:09:04.722878 27553 raft_consensus.cc:319] T 7d1359dc00a24df68d41c2447e367f1d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.722885 27553 raft_consensus.cc:548] T 7d1359dc00a24df68d41c2447e367f1d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.722887 32807 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(005a48fb466c4a52896842dd00124755) I1031 23:09:04.722898 27553 consensus_queue.cc:176] T 7d1359dc00a24df68d41c2447e367f1d P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.722898 32807 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(005a48fb466c4a52896842dd00124755) I1031 23:09:04.722918 32807 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(005a48fb466c4a52896842dd00124755) I1031 23:09:04.722931 32807 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(005a48fb466c4a52896842dd00124755) I1031 23:09:04.722957 32807 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(005a48fb466c4a52896842dd00124755) I1031 23:09:04.722973 32807 raft_consensus.cc:1569] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.722982 32803 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.722982 32807 raft_consensus.cc:1585] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.723000 32810 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.723002 32803 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: bff7dab34ccd4b42842077e82106f6fb I1031 23:09:04.723019 32810 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: 4b81a7f36c9a4b24a3294e39fdf19d9d I1031 23:09:04.723021 27543 ts_tablet_manager.cc:755] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s I1031 23:09:04.723029 32803 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(bff7dab34ccd4b42842077e82106f6fb) I1031 23:09:04.723038 32810 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(4b81a7f36c9a4b24a3294e39fdf19d9d) I1031 23:09:04.723057 32803 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(bff7dab34ccd4b42842077e82106f6fb) I1031 23:09:04.723063 32810 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(4b81a7f36c9a4b24a3294e39fdf19d9d) I1031 23:09:04.723068 32803 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(bff7dab34ccd4b42842077e82106f6fb) I1031 23:09:04.723074 27543 ts_tablet_manager.cc:723] T 8566e0c79e674a74803cd1a15fec8cb2 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrapping tablet I1031 23:09:04.723083 32810 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(4b81a7f36c9a4b24a3294e39fdf19d9d) I1031 23:09:04.723085 32803 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(bff7dab34ccd4b42842077e82106f6fb) I1031 23:09:04.723091 32810 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(4b81a7f36c9a4b24a3294e39fdf19d9d) I1031 23:09:04.723095 32803 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(bff7dab34ccd4b42842077e82106f6fb) I1031 23:09:04.723104 32803 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(bff7dab34ccd4b42842077e82106f6fb) I1031 23:09:04.723112 32803 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(bff7dab34ccd4b42842077e82106f6fb) I1031 23:09:04.723119 32810 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(4b81a7f36c9a4b24a3294e39fdf19d9d) I1031 23:09:04.723121 32803 raft_consensus.cc:1569] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.723139 32803 raft_consensus.cc:1585] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.723143 32810 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(4b81a7f36c9a4b24a3294e39fdf19d9d) I1031 23:09:04.723152 32810 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(4b81a7f36c9a4b24a3294e39fdf19d9d) I1031 23:09:04.723162 32810 raft_consensus.cc:1569] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.723172 32810 raft_consensus.cc:1585] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.723227 32811 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.723243 32811 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: d67c8d7da92f4f10b75858f21d80f8c4 I1031 23:09:04.723256 32811 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(d67c8d7da92f4f10b75858f21d80f8c4) I1031 23:09:04.723268 32811 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(d67c8d7da92f4f10b75858f21d80f8c4) I1031 23:09:04.723278 32811 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(d67c8d7da92f4f10b75858f21d80f8c4) I1031 23:09:04.723287 32811 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(d67c8d7da92f4f10b75858f21d80f8c4) I1031 23:09:04.723306 32811 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(d67c8d7da92f4f10b75858f21d80f8c4) I1031 23:09:04.723316 32811 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(d67c8d7da92f4f10b75858f21d80f8c4) I1031 23:09:04.723325 32811 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(d67c8d7da92f4f10b75858f21d80f8c4) I1031 23:09:04.723335 32811 raft_consensus.cc:1569] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.723343 32811 raft_consensus.cc:1585] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.723386 27543 tablet_bootstrap.cc:382] T 8566e0c79e674a74803cd1a15fec8cb2 P 23f962e4a1744381ad5fa0d2d8b10241: Bootstrap starting. I1031 23:09:04.723510 27543 tablet_bootstrap.cc:541] T 8566e0c79e674a74803cd1a15fec8cb2 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1031 23:09:04.723651 27543 tablet_bootstrap.cc:484] T 8566e0c79e674a74803cd1a15fec8cb2 P 23f962e4a1744381ad5fa0d2d8b10241: No blocks or log segments found. Creating new log. I1031 23:09:04.724273 32802 ts_tablet_manager.cc:1020] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.724366 32815 ts_tablet_manager.cc:1020] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.724417 27553 ts_tablet_manager.cc:755] T 7d1359dc00a24df68d41c2447e367f1d P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s I1031 23:09:04.725246 32814 ts_tablet_manager.cc:1020] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.726197 32817 ts_tablet_manager.cc:1020] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.726934 32810 ts_tablet_manager.cc:1020] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.726958 32811 ts_tablet_manager.cc:1020] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.726987 32807 ts_tablet_manager.cc:1020] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.727150 32803 ts_tablet_manager.cc:1020] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.734272 27538 tablet_bootstrap.cc:382] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.734274 27563 tablet_bootstrap.cc:382] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.734299 30495 raft_consensus.cc:411] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:04.734308 27563 ts_tablet_manager.cc:728] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.000s I1031 23:09:04.734302 27538 ts_tablet_manager.cc:728] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.001s I1031 23:09:04.734351 27558 tablet_bootstrap.cc:382] T 47eeb8448c454968a45bf1a984427b25 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.734810 30495 raft_consensus.cc:2162] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.570s I1031 23:09:04.734822 27558 ts_tablet_manager.cc:728] T 47eeb8448c454968a45bf1a984427b25 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.000s I1031 23:09:04.734850 27533 tablet_bootstrap.cc:382] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.734864 30495 raft_consensus.cc:435] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f53a0d3ef7e44ebb0365c800752d5bd" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st01.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:04.734879 27533 ts_tablet_manager.cc:728] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s I1031 23:09:04.735162 27543 tablet_bootstrap.cc:382] T 8566e0c79e674a74803cd1a15fec8cb2 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.735174 27568 tablet_bootstrap.cc:382] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.735190 27543 ts_tablet_manager.cc:728] T 8566e0c79e674a74803cd1a15fec8cb2 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.001s I1031 23:09:04.735198 27568 ts_tablet_manager.cc:728] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s I1031 23:09:04.735420 27548 tablet_bootstrap.cc:382] T db5874009dd84d4892fccdb3316010c2 P 23f962e4a1744381ad5fa0d2d8b10241: No bootstrap required, opened a new log I1031 23:09:04.735442 27548 ts_tablet_manager.cc:728] T db5874009dd84d4892fccdb3316010c2 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s I1031 23:09:04.737260 27563 raft_consensus.cc:288] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0f53a0d3ef7e44ebb0365c800752d5bd" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st01.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:09:04.737280 27563 raft_consensus.cc:319] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.737291 27563 raft_consensus.cc:548] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.737303 27563 consensus_queue.cc:176] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.737574 27543 raft_consensus.cc:288] T 8566e0c79e674a74803cd1a15fec8cb2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:04.737591 27538 raft_consensus.cc:288] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:04.737599 27558 raft_consensus.cc:288] T 47eeb8448c454968a45bf1a984427b25 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } I1031 23:09:04.737610 27538 raft_consensus.cc:319] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.737593 27543 raft_consensus.cc:319] T 8566e0c79e674a74803cd1a15fec8cb2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.737622 27538 raft_consensus.cc:548] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.737625 27558 raft_consensus.cc:319] T 47eeb8448c454968a45bf1a984427b25 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.737623 27543 raft_consensus.cc:548] T 8566e0c79e674a74803cd1a15fec8cb2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.737644 27543 consensus_queue.cc:176] T 8566e0c79e674a74803cd1a15fec8cb2 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.737640 27558 raft_consensus.cc:548] T 47eeb8448c454968a45bf1a984427b25 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.737639 27568 raft_consensus.cc:288] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:09:04.737640 27538 consensus_queue.cc:176] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.737663 27558 consensus_queue.cc:176] T 47eeb8448c454968a45bf1a984427b25 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.737665 27568 raft_consensus.cc:319] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.737679 27568 raft_consensus.cc:548] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.737679 27533 raft_consensus.cc:288] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } I1031 23:09:04.737695 27568 consensus_queue.cc:176] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.737711 27533 raft_consensus.cc:319] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.737722 27533 raft_consensus.cc:548] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.737736 27533 consensus_queue.cc:176] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.738916 27563 ts_tablet_manager.cc:755] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s I1031 23:09:04.738950 27548 raft_consensus.cc:288] T db5874009dd84d4892fccdb3316010c2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:09:04.738965 27548 raft_consensus.cc:319] T db5874009dd84d4892fccdb3316010c2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1031 23:09:04.738976 27548 raft_consensus.cc:548] T db5874009dd84d4892fccdb3316010c2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f962e4a1744381ad5fa0d2d8b10241, State: 1, Role: FOLLOWER I1031 23:09:04.738987 27548 consensus_queue.cc:176] T db5874009dd84d4892fccdb3316010c2 P 23f962e4a1744381ad5fa0d2d8b10241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1031 23:09:04.739147 32804 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.739166 32804 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: 012b21c0f95e4dd594076018fd6fdb7e I1031 23:09:04.739181 32804 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(012b21c0f95e4dd594076018fd6fdb7e) I1031 23:09:04.739192 32804 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(012b21c0f95e4dd594076018fd6fdb7e) I1031 23:09:04.739203 32804 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(012b21c0f95e4dd594076018fd6fdb7e) I1031 23:09:04.739215 32804 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(012b21c0f95e4dd594076018fd6fdb7e) I1031 23:09:04.739228 32804 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(012b21c0f95e4dd594076018fd6fdb7e) I1031 23:09:04.739238 32804 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(012b21c0f95e4dd594076018fd6fdb7e) I1031 23:09:04.739248 32804 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(012b21c0f95e4dd594076018fd6fdb7e) I1031 23:09:04.739259 32804 raft_consensus.cc:1569] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.739269 32804 raft_consensus.cc:1585] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.739918 27568 ts_tablet_manager.cc:755] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s I1031 23:09:04.740191 30495 leader_election.cc:216] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0f53a0d3ef7e44ebb0365c800752d5bd I1031 23:09:04.740227 30495 leader_election.cc:216] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:09:04.740229 27558 ts_tablet_manager.cc:755] T 47eeb8448c454968a45bf1a984427b25 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s I1031 23:09:04.740259 27533 ts_tablet_manager.cc:755] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s I1031 23:09:04.740303 27538 ts_tablet_manager.cc:755] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s I1031 23:09:04.740357 27543 ts_tablet_manager.cc:755] T 8566e0c79e674a74803cd1a15fec8cb2 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s I1031 23:09:04.740372 27548 ts_tablet_manager.cc:755] T db5874009dd84d4892fccdb3316010c2 P 23f962e4a1744381ad5fa0d2d8b10241: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s I1031 23:09:04.740458 32770 leader_election.cc:362] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 0f53a0d3ef7e44ebb0365c800752d5bd. Message: Invalid argument: T 991306ec7acb449c89e5dd29d90e8d55 P 0f53a0d3ef7e44ebb0365c800752d5bd [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 23f962e4a1744381ad5fa0d2d8b10241 for term 1 because replica is either leader or believes a valid leader to be alive. I1031 23:09:04.740583 32770 leader_election.cc:362] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Vote denied by peer daba39963d4346e1816089fd3a5442b5. Message: Invalid argument: T 991306ec7acb449c89e5dd29d90e8d55 P daba39963d4346e1816089fd3a5442b5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23f962e4a1744381ad5fa0d2d8b10241 for term 1 because replica is either leader or believes a valid leader to be alive. I1031 23:09:04.740598 32770 leader_election.cc:243] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:04.740651 30498 raft_consensus.cc:2162] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.904s I1031 23:09:04.740669 30498 raft_consensus.cc:2206] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:09:04.740738 32818 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.740756 32818 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: f2af422919fd4560bd6441509a68d64b I1031 23:09:04.740772 32818 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(f2af422919fd4560bd6441509a68d64b) I1031 23:09:04.740787 32818 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(f2af422919fd4560bd6441509a68d64b) I1031 23:09:04.740798 32818 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(f2af422919fd4560bd6441509a68d64b) I1031 23:09:04.740809 32818 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(f2af422919fd4560bd6441509a68d64b) I1031 23:09:04.740823 32818 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(f2af422919fd4560bd6441509a68d64b) I1031 23:09:04.740831 32818 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(f2af422919fd4560bd6441509a68d64b) I1031 23:09:04.740842 32818 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(f2af422919fd4560bd6441509a68d64b) I1031 23:09:04.740851 32818 raft_consensus.cc:1569] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.740862 32818 raft_consensus.cc:1585] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.741122 32813 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:04.741144 32813 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: 32984b820db347e1b2d4d0786cf221f2 I1031 23:09:04.741160 32813 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(32984b820db347e1b2d4d0786cf221f2) I1031 23:09:04.741173 32813 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(32984b820db347e1b2d4d0786cf221f2) I1031 23:09:04.741184 32813 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(32984b820db347e1b2d4d0786cf221f2) I1031 23:09:04.741194 30498 raft_consensus.cc:1908] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:04.741196 32813 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(32984b820db347e1b2d4d0786cf221f2) I1031 23:09:04.741233 32813 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(32984b820db347e1b2d4d0786cf221f2) I1031 23:09:04.741250 32813 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(32984b820db347e1b2d4d0786cf221f2) I1031 23:09:04.741263 32813 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(32984b820db347e1b2d4d0786cf221f2) I1031 23:09:04.741278 32813 raft_consensus.cc:1569] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:09:04.741289 32813 raft_consensus.cc:1585] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:09:04.742014 32804 ts_tablet_manager.cc:1020] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.742843 32818 ts_tablet_manager.cc:1020] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.743371 32813 ts_tablet_manager.cc:1020] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:09:04.752004 32827 raft_consensus.cc:2206] T db5874009dd84d4892fccdb3316010c2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:09:04.752516 32827 raft_consensus.cc:918] T db5874009dd84d4892fccdb3316010c2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 044f1da9a27c46acb82b1386f829f4dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:09:04.780004 32831 raft_consensus.cc:2206] T 42d56cd12bbb4bed9973f96a230fdb9e P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:09:04.780464 32831 raft_consensus.cc:918] T 42d56cd12bbb4bed9973f96a230fdb9e P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer d3eb30bd1bc34b95902fa61724239553: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:09:04.870645 32831 raft_consensus.cc:2206] T 8566e0c79e674a74803cd1a15fec8cb2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:09:04.871019 32831 raft_consensus.cc:918] T 8566e0c79e674a74803cd1a15fec8cb2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 193181be29284287b25df2ee92938f0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:09:04.892827 32831 raft_consensus.cc:2206] T 7d1359dc00a24df68d41c2447e367f1d P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:09:04.893214 32831 raft_consensus.cc:918] T 7d1359dc00a24df68d41c2447e367f1d P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 044f1da9a27c46acb82b1386f829f4dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:09:04.896715 30450 raft_consensus.cc:411] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:04.896742 30450 raft_consensus.cc:2162] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.735s I1031 23:09:04.896791 30450 raft_consensus.cc:435] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } I1031 23:09:04.897327 30450 leader_election.cc:216] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc I1031 23:09:04.897378 30450 leader_election.cc:216] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0fc477287c154136abc1e2f3c82fb7f9 I1031 23:09:04.897594 32773 leader_election.cc:362] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 044f1da9a27c46acb82b1386f829f4dc. Message: Invalid argument: T 13f1cd14968447f7951d92ce30c4b7c0 P 044f1da9a27c46acb82b1386f829f4dc [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 23f962e4a1744381ad5fa0d2d8b10241 for term 1 because replica is either leader or believes a valid leader to be alive. I1031 23:09:04.897804 32771 leader_election.cc:362] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 0fc477287c154136abc1e2f3c82fb7f9. Message: Invalid argument: T 13f1cd14968447f7951d92ce30c4b7c0 P 0fc477287c154136abc1e2f3c82fb7f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23f962e4a1744381ad5fa0d2d8b10241 for term 1 because replica is either leader or believes a valid leader to be alive. I1031 23:09:04.897825 32771 leader_election.cc:243] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:04.897861 30451 raft_consensus.cc:2162] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.797s I1031 23:09:04.897873 30451 raft_consensus.cc:2206] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:09:04.898346 30451 raft_consensus.cc:1908] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:04.922669 30537 raft_consensus.cc:411] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:04.922696 30537 raft_consensus.cc:2162] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.109s I1031 23:09:04.922734 30537 raft_consensus.cc:435] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:09:04.923246 30537 leader_election.cc:216] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:09:04.923295 30537 leader_election.cc:216] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc I1031 23:09:04.923636 32773 leader_election.cc:362] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 044f1da9a27c46acb82b1386f829f4dc. Message: Invalid argument: T bb4c891b261b42ef9b983f46cefef6ae P 044f1da9a27c46acb82b1386f829f4dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23f962e4a1744381ad5fa0d2d8b10241 for term 1 because replica is either leader or believes a valid leader to be alive. I1031 23:09:04.923739 32772 leader_election.cc:362] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 193181be29284287b25df2ee92938f0b. Message: Invalid argument: T bb4c891b261b42ef9b983f46cefef6ae P 193181be29284287b25df2ee92938f0b [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 23f962e4a1744381ad5fa0d2d8b10241 for term 1 because replica is either leader or believes a valid leader to be alive. I1031 23:09:04.923759 32772 leader_election.cc:243] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:04.923852 30544 raft_consensus.cc:2162] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.561s I1031 23:09:04.923873 30544 raft_consensus.cc:2206] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:09:04.970232 30465 raft_consensus.cc:411] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:04.970263 30465 raft_consensus.cc:2162] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.522s I1031 23:09:04.970316 30465 raft_consensus.cc:435] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc477287c154136abc1e2f3c82fb7f9" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st04.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } I1031 23:09:04.970788 30465 leader_election.cc:216] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0fc477287c154136abc1e2f3c82fb7f9 I1031 23:09:04.970816 30465 leader_election.cc:216] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 I1031 23:09:04.971099 32772 leader_election.cc:362] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Vote denied by peer d3eb30bd1bc34b95902fa61724239553. Message: Invalid argument: T c1be6b6a217c475b9aed375afd1f491b P d3eb30bd1bc34b95902fa61724239553 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23f962e4a1744381ad5fa0d2d8b10241 for term 1 because replica is either leader or believes a valid leader to be alive. I1031 23:09:04.971222 32771 leader_election.cc:362] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 0fc477287c154136abc1e2f3c82fb7f9. Message: Invalid argument: T c1be6b6a217c475b9aed375afd1f491b P 0fc477287c154136abc1e2f3c82fb7f9 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 23f962e4a1744381ad5fa0d2d8b10241 for term 1 because replica is either leader or believes a valid leader to be alive. I1031 23:09:04.971245 32771 leader_election.cc:243] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:04.971295 30472 raft_consensus.cc:2162] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.683s I1031 23:09:04.971321 30472 raft_consensus.cc:2206] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:09:04.991638 30544 raft_consensus.cc:1908] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:04.991720 30472 raft_consensus.cc:1908] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:05.009945 32831 raft_consensus.cc:918] T 13f1cd14968447f7951d92ce30c4b7c0 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 044f1da9a27c46acb82b1386f829f4dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:09:05.010702 32827 raft_consensus.cc:918] T bb4c891b261b42ef9b983f46cefef6ae P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 193181be29284287b25df2ee92938f0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:09:05.013514 32827 raft_consensus.cc:918] T c1be6b6a217c475b9aed375afd1f491b P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 0fc477287c154136abc1e2f3c82fb7f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:09:05.028066 32827 raft_consensus.cc:2206] T 47eeb8448c454968a45bf1a984427b25 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:09:05.028425 32827 raft_consensus.cc:918] T 47eeb8448c454968a45bf1a984427b25 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 0a8bbcbbb5a6459aa5258464755db3bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:09:05.075750 32831 raft_consensus.cc:2206] T 68aa6071fa594e79958cddb8489a1f0c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:09:05.076133 32831 raft_consensus.cc:918] T 68aa6071fa594e79958cddb8489a1f0c P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 0a8bbcbbb5a6459aa5258464755db3bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:09:05.088610 32760 tablet.cc:1259] T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I1031 23:09:05.089673 32760 tablet.cc:1314] T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Flush Phase 2: carrying over any updates which arrived during Phase 1 I1031 23:09:05.089691 32760 tablet.cc:1316] T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6182758582111772672 or (T in {6182758582111772672})}] I1031 23:09:05.106129 30468 raft_consensus.cc:411] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:05.106160 30468 raft_consensus.cc:2162] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.856s I1031 23:09:05.106197 30468 raft_consensus.cc:435] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:05.106724 30468 leader_election.cc:216] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:09:05.106765 30468 leader_election.cc:216] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc I1031 23:09:05.107041 32773 leader_election.cc:362] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 044f1da9a27c46acb82b1386f829f4dc. Message: Invalid argument: T cc323d8862bb429490b7ef96568245c5 P 044f1da9a27c46acb82b1386f829f4dc [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 23f962e4a1744381ad5fa0d2d8b10241 for term 1 because replica is either leader or believes a valid leader to be alive. I1031 23:09:05.107075 32772 leader_election.cc:362] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 193181be29284287b25df2ee92938f0b. Message: Invalid argument: T cc323d8862bb429490b7ef96568245c5 P 193181be29284287b25df2ee92938f0b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23f962e4a1744381ad5fa0d2d8b10241 for term 1 because replica is either leader or believes a valid leader to be alive. I1031 23:09:05.107089 32772 leader_election.cc:243] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:05.107158 30477 raft_consensus.cc:2162] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.097s I1031 23:09:05.107179 30477 raft_consensus.cc:2206] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:09:05.107647 30477 raft_consensus.cc:1908] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:05.109177 32831 raft_consensus.cc:918] T cc323d8862bb429490b7ef96568245c5 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 044f1da9a27c46acb82b1386f829f4dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:09:05.114826 32831 raft_consensus.cc:918] T 991306ec7acb449c89e5dd29d90e8d55 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 0f53a0d3ef7e44ebb0365c800752d5bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:09:05.130522 32831 raft_consensus.cc:2206] T fcde65c4e4cf4df29b9ef9884ce292b2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Advancing to term 1 I1031 23:09:05.134865 32831 raft_consensus.cc:918] T fcde65c4e4cf4df29b9ef9884ce292b2 P 23f962e4a1744381ad5fa0d2d8b10241 [term 1 FOLLOWER]: Refusing update from remote peer 0f53a0d3ef7e44ebb0365c800752d5bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I1031 23:09:05.269290 32807 ts_tablet_manager.cc:1032] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.269338 32807 log.cc:876] T 005a48fb466c4a52896842dd00124755 P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/005a48fb466c4a52896842dd00124755 I1031 23:09:05.269522 32807 consensus_meta.cc:71] T 005a48fb466c4a52896842dd00124755 Deleting consensus metadata I1031 23:09:05.294723 32805 ts_tablet_manager.cc:1032] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.294750 32805 log.cc:876] T f0a40a8745bb4f4abbe8b304ebc7626c P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/f0a40a8745bb4f4abbe8b304ebc7626c I1031 23:09:05.294878 32805 consensus_meta.cc:71] T f0a40a8745bb4f4abbe8b304ebc7626c Deleting consensus metadata I1031 23:09:05.480214 32802 ts_tablet_manager.cc:1032] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.480249 32802 log.cc:876] T 46fc46e028434bc69f467922a9a59101 P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/46fc46e028434bc69f467922a9a59101 I1031 23:09:05.480401 32802 consensus_meta.cc:71] T 46fc46e028434bc69f467922a9a59101 Deleting consensus metadata I1031 23:09:05.505640 32809 ts_tablet_manager.cc:1032] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.505671 32809 log.cc:876] T f49a4f915ac048b096fcb5f4878f436d P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/f49a4f915ac048b096fcb5f4878f436d I1031 23:09:05.505820 32809 consensus_meta.cc:71] T f49a4f915ac048b096fcb5f4878f436d Deleting consensus metadata I1031 23:09:05.539974 32818 ts_tablet_manager.cc:1032] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.540055 32818 log.cc:876] T f2af422919fd4560bd6441509a68d64b P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/f2af422919fd4560bd6441509a68d64b I1031 23:09:05.540269 32818 consensus_meta.cc:71] T f2af422919fd4560bd6441509a68d64b Deleting consensus metadata I1031 23:09:05.573804 32810 ts_tablet_manager.cc:1032] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.573837 32810 log.cc:876] T 4b81a7f36c9a4b24a3294e39fdf19d9d P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/4b81a7f36c9a4b24a3294e39fdf19d9d I1031 23:09:05.573956 32810 consensus_meta.cc:71] T 4b81a7f36c9a4b24a3294e39fdf19d9d Deleting consensus metadata I1031 23:09:05.599175 32813 ts_tablet_manager.cc:1032] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.599242 32813 log.cc:876] T 32984b820db347e1b2d4d0786cf221f2 P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/32984b820db347e1b2d4d0786cf221f2 I1031 23:09:05.599390 32813 consensus_meta.cc:71] T 32984b820db347e1b2d4d0786cf221f2 Deleting consensus metadata I1031 23:09:05.632755 32817 ts_tablet_manager.cc:1032] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.632789 32817 log.cc:876] T b758ec3274c84dcbb110cf5aa3dca9aa P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/b758ec3274c84dcbb110cf5aa3dca9aa I1031 23:09:05.632920 32817 consensus_meta.cc:71] T b758ec3274c84dcbb110cf5aa3dca9aa Deleting consensus metadata I1031 23:09:05.691910 32804 ts_tablet_manager.cc:1032] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.691961 32804 log.cc:876] T 012b21c0f95e4dd594076018fd6fdb7e P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/012b21c0f95e4dd594076018fd6fdb7e I1031 23:09:05.692080 32804 consensus_meta.cc:71] T 012b21c0f95e4dd594076018fd6fdb7e Deleting consensus metadata I1031 23:09:05.717308 32806 ts_tablet_manager.cc:1032] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.717336 32806 log.cc:876] T 27f651ff46ca4722b064a85e795dcaa4 P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/27f651ff46ca4722b064a85e795dcaa4 I1031 23:09:05.717453 32806 consensus_meta.cc:71] T 27f651ff46ca4722b064a85e795dcaa4 Deleting consensus metadata I1031 23:09:05.742624 32811 ts_tablet_manager.cc:1032] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.742677 32811 log.cc:876] T d67c8d7da92f4f10b75858f21d80f8c4 P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/d67c8d7da92f4f10b75858f21d80f8c4 I1031 23:09:05.742802 32811 consensus_meta.cc:71] T d67c8d7da92f4f10b75858f21d80f8c4 Deleting consensus metadata I1031 23:09:05.784639 32809 rpcz_store.cc:248] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 10.108.187.10:62607 (request call id 287) took 1068ms. Request Metrics: {"fdatasync":2,"fdatasync_us":311962} I1031 23:09:05.784639 32802 rpcz_store.cc:248] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 10.108.187.10:62607 (request call id 290) took 1065ms. Request Metrics: {"fdatasync":2,"fdatasync_us":307907} I1031 23:09:05.784920 32818 rpcz_store.cc:248] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 10.108.187.10:62607 (request call id 299) took 1044ms. Request Metrics: {"fdatasync":2,"fdatasync_us":289658} I1031 23:09:05.818397 32810 rpcz_store.cc:248] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 10.108.187.10:62607 (request call id 296) took 1095ms. Request Metrics: {"fdatasync":2,"fdatasync_us":306033} I1031 23:09:05.818460 32813 rpcz_store.cc:248] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 10.108.187.10:62607 (request call id 300) took 1077ms. Request Metrics: {"fdatasync":2,"fdatasync_us":288839} I1031 23:09:05.819526 32760 tablet.cc:1358] T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Flush successful on 2029 rows (311919 bytes) I1031 23:09:05.819885 32760 maintenance_manager.cc:419] Time spent running FlushMRSOp(03802df37c9543298202506697cc8906): real 1.139s user 0.019s sys 0.000s I1031 23:09:05.819924 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: FlushMRSOp(03802df37c9543298202506697cc8906) metrics: {"cfile_init":1,"data dir 4.queue_time_us":331,"data dir 4.run_cpu_time_us":118,"data dir 4.run_wall_time_us":23300,"fdatasync":29,"fdatasync_us":426401,"lbm_read_time_us":5,"lbm_reads_lt_1ms":4,"lbm_write_time_us":744,"lbm_writes_lt_1ms":87,"tcmalloc_contention_cycles":194560,"thread_start_us":319,"threads_started":1} I1031 23:09:05.843828 32814 ts_tablet_manager.cc:1032] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.843871 32814 log.cc:876] T 0ea66c65e2d4445eb9cc83ba7ee1448b P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/0ea66c65e2d4445eb9cc83ba7ee1448b I1031 23:09:05.843917 32817 rpcz_store.cc:248] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 10.108.187.10:62607 (request call id 293) took 1122ms. Request Metrics: {"fdatasync":2,"fdatasync_us":306332} I1031 23:09:05.844005 32814 consensus_meta.cc:71] T 0ea66c65e2d4445eb9cc83ba7ee1448b Deleting consensus metadata I1031 23:09:05.869109 32801 ts_tablet_manager.cc:1032] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.869135 32801 log.cc:876] T 5110f0095bd94f67abf0aad906332efe P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/5110f0095bd94f67abf0aad906332efe I1031 23:09:05.869246 32804 rpcz_store.cc:248] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 10.108.187.10:62607 (request call id 298) took 1130ms. Request Metrics: {"fdatasync":2,"fdatasync_us":290468} I1031 23:09:05.869256 32806 rpcz_store.cc:248] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 10.108.187.10:62607 (request call id 286) took 1154ms. Request Metrics: {"fdatasync":2,"fdatasync_us":313441,"mutex_wait_us":44} I1031 23:09:05.869292 32801 consensus_meta.cc:71] T 5110f0095bd94f67abf0aad906332efe Deleting consensus metadata I1031 23:09:05.869341 32811 rpcz_store.cc:248] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 10.108.187.10:62607 (request call id 297) took 1146ms. Request Metrics: {"fdatasync":2,"fdatasync_us":305530} I1031 23:09:05.903044 32815 ts_tablet_manager.cc:1032] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.903085 32815 log.cc:876] T 80ba7f33ec864c5f96c61932edb5cdc4 P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/80ba7f33ec864c5f96c61932edb5cdc4 I1031 23:09:05.903192 32814 rpcz_store.cc:248] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 10.108.187.10:62607 (request call id 292) took 1183ms. Request Metrics: {"fdatasync":2,"fdatasync_us":307310} I1031 23:09:05.903204 32815 consensus_meta.cc:71] T 80ba7f33ec864c5f96c61932edb5cdc4 Deleting consensus metadata I1031 23:09:05.928447 32803 ts_tablet_manager.cc:1032] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:09:05.928506 32803 log.cc:876] T bff7dab34ccd4b42842077e82106f6fb P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/bff7dab34ccd4b42842077e82106f6fb I1031 23:09:05.928565 32801 rpcz_store.cc:248] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 10.108.187.10:62607 (request call id 289) took 1211ms. Request Metrics: {"fdatasync":2,"fdatasync_us":311538} I1031 23:09:05.928594 32815 rpcz_store.cc:248] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 10.108.187.10:62607 (request call id 291) took 1209ms. Request Metrics: {"fdatasync":2,"fdatasync_us":308027,"mutex_wait_us":5} I1031 23:09:05.928670 32803 consensus_meta.cc:71] T bff7dab34ccd4b42842077e82106f6fb Deleting consensus metadata I1031 23:09:05.928793 32803 rpcz_store.cc:248] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 10.108.187.10:62607 (request call id 295) took 1205ms. Request Metrics: {"fdatasync":2,"fdatasync_us":305365} I1031 23:09:05.964252 32760 tablet.cc:911] T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering stage 1 (old memrowset already frozen for inserts) I1031 23:09:05.964273 32760 compaction.cc:877] Selected 1 rowsets to compact: I1031 23:09:05.964282 32760 compaction.cc:880] memrowset(current size on disk: ~0 bytes) I1031 23:09:05.964287 32760 tablet.cc:913] T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Memstore in-memory size: 1019671 bytes I1031 23:09:05.964295 32760 tablet.cc:1174] T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6182758586410422272 or (T in {6182758586410422272})}] I1031 23:09:05.964409 32760 multi_column_writer.cc:85] Opened CFile writer for column olap_date[int32 NOT NULL] I1031 23:09:05.964448 32760 multi_column_writer.cc:85] Opened CFile writer for column timestamp[int64 NOT NULL] I1031 23:09:05.964480 32760 multi_column_writer.cc:85] Opened CFile writer for column tweet_id[int64 NOT NULL] I1031 23:09:05.964520 32760 multi_column_writer.cc:85] Opened CFile writer for column created_at[string NULLABLE] I1031 23:09:05.964566 32760 multi_column_writer.cc:85] Opened CFile writer for column text[string NULLABLE] I1031 23:09:05.964601 32760 multi_column_writer.cc:85] Opened CFile writer for column source[string NULLABLE] I1031 23:09:05.964633 32760 multi_column_writer.cc:85] Opened CFile writer for column user_id[int64 NULLABLE] I1031 23:09:05.964682 32760 multi_column_writer.cc:85] Opened CFile writer for column user_name[string NULLABLE] I1031 23:09:05.964714 32760 multi_column_writer.cc:85] Opened CFile writer for column user_location[string NULLABLE] I1031 23:09:05.964745 32760 multi_column_writer.cc:85] Opened CFile writer for column user_followers_count[int32 NULLABLE] I1031 23:09:05.964771 32760 multi_column_writer.cc:85] Opened CFile writer for column user_friends_count[int32 NULLABLE] I1031 23:09:06.016544 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:06.016602 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.907s I1031 23:09:06.016649 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:09:06.017282 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:09:06.017324 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:09:06.017555 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:09:06.017679 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:09:06.017700 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:06.017835 30566 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.943s I1031 23:09:06.017854 30566 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:06.266911 32760 tablet.cc:1259] T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I1031 23:09:06.267727 32760 tablet.cc:1314] T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush Phase 2: carrying over any updates which arrived during Phase 1 I1031 23:09:06.267742 32760 tablet.cc:1316] T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6182758589227958272 or (T in {6182758589227958272})}] I1031 23:09:06.321962 32760 tablet.cc:1358] T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush successful on 1970 rows (305448 bytes) I1031 23:09:06.322244 32760 maintenance_manager.cc:419] Time spent running FlushMRSOp(2765976a053c4287874c0cb2fb7781b2): real 0.359s user 0.014s sys 0.002s I1031 23:09:06.322276 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: FlushMRSOp(2765976a053c4287874c0cb2fb7781b2) metrics: {"cfile_init":1,"data dir 3.queue_time_us":280,"data dir 3.run_cpu_time_us":150,"data dir 3.run_wall_time_us":14384,"fdatasync":29,"fdatasync_us":317185,"lbm_read_time_us":7,"lbm_reads_lt_1ms":4,"lbm_write_time_us":698,"lbm_writes_lt_1ms":87,"thread_start_us":269,"threads_started":1} I1031 23:09:06.530439 32760 maintenance_manager.cc:419] Time spent running UndoDeltaBlockGCOp(3a949c88a8864d509b058fddddebc6d2): real 0.044s user 0.002s sys 0.000s I1031 23:09:06.530545 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: UndoDeltaBlockGCOp(3a949c88a8864d509b058fddddebc6d2) metrics: {"cfile_init":1,"data dir 4.queue_time_us":201,"data dir 4.run_cpu_time_us":75,"data dir 4.run_wall_time_us":75,"fdatasync":1,"fdatasync_us":24793,"lbm_read_time_us":7,"lbm_reads_lt_1ms":4,"thread_start_us":189,"threads_started":1} I1031 23:09:06.805884 32760 maintenance_manager.cc:419] Time spent running UndoDeltaBlockGCOp(03802df37c9543298202506697cc8906): real 0.049s user 0.002s sys 0.000s I1031 23:09:06.806036 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: UndoDeltaBlockGCOp(03802df37c9543298202506697cc8906) metrics: {"cfile_init":1,"data dir 7.queue_time_us":242,"data dir 7.run_cpu_time_us":62,"data dir 7.run_wall_time_us":62,"fdatasync":1,"fdatasync_us":30072,"lbm_read_time_us":8,"lbm_reads_lt_1ms":4,"thread_start_us":230,"threads_started":1} I1031 23:09:06.855870 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:06.855924 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.492s I1031 23:09:06.855973 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:09:06.856501 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:09:06.856528 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:09:06.856827 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:09:06.856935 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:09:06.856956 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:06.857156 30571 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.606s I1031 23:09:06.857178 30571 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:06.904294 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:06.904317 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.428s I1031 23:09:06.904371 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:09:06.904852 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:09:06.904875 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:09:06.905233 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:09:06.905299 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:09:06.905323 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:06.905493 30572 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.092s I1031 23:09:06.905514 30572 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:07.073133 32760 maintenance_manager.cc:419] Time spent running UndoDeltaBlockGCOp(2765976a053c4287874c0cb2fb7781b2): real 0.046s user 0.002s sys 0.000s I1031 23:09:07.073171 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: UndoDeltaBlockGCOp(2765976a053c4287874c0cb2fb7781b2) metrics: {"cfile_init":1,"data dir 6.queue_time_us":209,"data dir 6.run_cpu_time_us":58,"data dir 6.run_wall_time_us":58,"fdatasync":1,"fdatasync_us":26752,"lbm_read_time_us":8,"lbm_reads_lt_1ms":4,"thread_start_us":199,"threads_started":1} I1031 23:09:07.299185 32760 tablet.cc:911] T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering stage 1 (old memrowset already frozen for inserts) I1031 23:09:07.299221 32760 compaction.cc:877] Selected 1 rowsets to compact: I1031 23:09:07.299228 32760 compaction.cc:880] memrowset(current size on disk: ~0 bytes) I1031 23:09:07.299234 32760 tablet.cc:913] T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Memstore in-memory size: 1019671 bytes I1031 23:09:07.299243 32760 tablet.cc:1174] T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6182758593453412352 or (T in {6182758593453412352})}] I1031 23:09:07.299345 32760 multi_column_writer.cc:85] Opened CFile writer for column olap_date[int32 NOT NULL] I1031 23:09:07.299391 32760 multi_column_writer.cc:85] Opened CFile writer for column timestamp[int64 NOT NULL] I1031 23:09:07.299420 32760 multi_column_writer.cc:85] Opened CFile writer for column tweet_id[int64 NOT NULL] I1031 23:09:07.299455 32760 multi_column_writer.cc:85] Opened CFile writer for column created_at[string NULLABLE] I1031 23:09:07.299494 32760 multi_column_writer.cc:85] Opened CFile writer for column text[string NULLABLE] I1031 23:09:07.299526 32760 multi_column_writer.cc:85] Opened CFile writer for column source[string NULLABLE] I1031 23:09:07.299556 32760 multi_column_writer.cc:85] Opened CFile writer for column user_id[int64 NULLABLE] I1031 23:09:07.299613 32760 multi_column_writer.cc:85] Opened CFile writer for column user_name[string NULLABLE] I1031 23:09:07.299659 32760 multi_column_writer.cc:85] Opened CFile writer for column user_location[string NULLABLE] I1031 23:09:07.299688 32760 multi_column_writer.cc:85] Opened CFile writer for column user_followers_count[int32 NULLABLE] I1031 23:09:07.299718 32760 multi_column_writer.cc:85] Opened CFile writer for column user_friends_count[int32 NULLABLE] I1031 23:09:07.530020 32760 tablet.cc:1259] T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I1031 23:09:07.530797 32760 tablet.cc:1314] T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Flush Phase 2: carrying over any updates which arrived during Phase 1 I1031 23:09:07.530813 32760 tablet.cc:1316] T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6182758594147270656 or (T in {6182758594147270656})}] I1031 23:09:07.574647 32760 tablet.cc:1358] T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Flush successful on 2064 rows (315631 bytes) I1031 23:09:07.574903 32760 maintenance_manager.cc:419] Time spent running FlushMRSOp(3123639d9835456b9f5dab3f7dd7ebd9): real 0.277s user 0.014s sys 0.002s I1031 23:09:07.574934 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: FlushMRSOp(3123639d9835456b9f5dab3f7dd7ebd9) metrics: {"cfile_init":1,"data dir 2.queue_time_us":164,"data dir 2.run_cpu_time_us":141,"data dir 2.run_wall_time_us":80978,"fdatasync":29,"fdatasync_us":242730,"lbm_read_time_us":5,"lbm_reads_lt_1ms":4,"lbm_write_time_us":726,"lbm_writes_lt_1ms":87,"thread_start_us":153,"threads_started":1} I1031 23:09:07.821687 32760 tablet.cc:911] T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering stage 1 (old memrowset already frozen for inserts) I1031 23:09:07.821732 32760 compaction.cc:877] Selected 1 rowsets to compact: I1031 23:09:07.821741 32760 compaction.cc:880] memrowset(current size on disk: ~0 bytes) I1031 23:09:07.821748 32760 tablet.cc:913] T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Memstore in-memory size: 1019671 bytes I1031 23:09:07.821755 32760 tablet.cc:1174] T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6182758594574151680 or (T in {6182758594574151680})}] I1031 23:09:07.821851 32760 multi_column_writer.cc:85] Opened CFile writer for column olap_date[int32 NOT NULL] I1031 23:09:07.821887 32760 multi_column_writer.cc:85] Opened CFile writer for column timestamp[int64 NOT NULL] I1031 23:09:07.821916 32760 multi_column_writer.cc:85] Opened CFile writer for column tweet_id[int64 NOT NULL] I1031 23:09:07.821960 32760 multi_column_writer.cc:85] Opened CFile writer for column created_at[string NULLABLE] I1031 23:09:07.821993 32760 multi_column_writer.cc:85] Opened CFile writer for column text[string NULLABLE] I1031 23:09:07.822024 32760 multi_column_writer.cc:85] Opened CFile writer for column source[string NULLABLE] I1031 23:09:07.822059 32760 multi_column_writer.cc:85] Opened CFile writer for column user_id[int64 NULLABLE] I1031 23:09:07.822106 32760 multi_column_writer.cc:85] Opened CFile writer for column user_name[string NULLABLE] I1031 23:09:07.822142 32760 multi_column_writer.cc:85] Opened CFile writer for column user_location[string NULLABLE] I1031 23:09:07.822167 32760 multi_column_writer.cc:85] Opened CFile writer for column user_followers_count[int32 NULLABLE] I1031 23:09:07.822193 32760 multi_column_writer.cc:85] Opened CFile writer for column user_friends_count[int32 NULLABLE] I1031 23:09:07.966717 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:07.966768 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.247s I1031 23:09:07.966826 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:09:07.967432 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:09:07.967468 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:09:07.967696 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:09:07.967762 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:09:07.967787 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:07.968051 30594 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.544s I1031 23:09:07.968076 30594 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:08.023378 32760 tablet.cc:1259] T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I1031 23:09:08.024355 32760 tablet.cc:1314] T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush Phase 2: carrying over any updates which arrived during Phase 1 I1031 23:09:08.024372 32760 tablet.cc:1316] T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6182758594574151680 or (T in {6182758594574151680})}] I1031 23:09:08.075459 32760 tablet.cc:1358] T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush successful on 1960 rows (301023 bytes) I1031 23:09:08.075742 32760 maintenance_manager.cc:419] Time spent running FlushMRSOp(3a949c88a8864d509b058fddddebc6d2): real 0.255s user 0.013s sys 0.003s I1031 23:09:08.075775 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: FlushMRSOp(3a949c88a8864d509b058fddddebc6d2) metrics: {"cfile_init":1,"data dir 1.queue_time_us":225,"data dir 1.run_cpu_time_us":135,"data dir 1.run_wall_time_us":11799,"fdatasync":29,"fdatasync_us":221858,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":656,"lbm_writes_lt_1ms":87,"mutex_wait_us":1,"thread_start_us":212,"threads_started":1} I1031 23:09:08.400681 32760 maintenance_manager.cc:419] Time spent running UndoDeltaBlockGCOp(3123639d9835456b9f5dab3f7dd7ebd9): real 0.049s user 0.002s sys 0.000s I1031 23:09:08.400797 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: UndoDeltaBlockGCOp(3123639d9835456b9f5dab3f7dd7ebd9) metrics: {"cfile_init":1,"data dir 5.queue_time_us":203,"data dir 5.run_cpu_time_us":83,"data dir 5.run_wall_time_us":83,"fdatasync":1,"fdatasync_us":30001,"lbm_read_time_us":7,"lbm_reads_lt_1ms":4,"thread_start_us":191,"threads_started":1} I1031 23:09:08.621685 32760 maintenance_manager.cc:419] Time spent running UndoDeltaBlockGCOp(3a949c88a8864d509b058fddddebc6d2): real 0.000s user 0.000s sys 0.000s I1031 23:09:08.621709 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: UndoDeltaBlockGCOp(3a949c88a8864d509b058fddddebc6d2) metrics: {"cfile_init":1,"lbm_read_time_us":7,"lbm_reads_lt_1ms":4} I1031 23:09:08.933727 32760 maintenance_manager.cc:419] Time spent running UndoDeltaBlockGCOp(3409046e569643c3a083c3f27cfe1582): real 0.041s user 0.041s sys 0.000s I1031 23:09:08.933784 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: UndoDeltaBlockGCOp(3409046e569643c3a083c3f27cfe1582) metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4} I1031 23:09:09.782491 32760 tablet.cc:911] T 3409046e569643c3a083c3f27cfe1582 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering stage 1 (old memrowset already frozen for inserts) I1031 23:09:09.782618 32760 compaction.cc:877] Selected 1 rowsets to compact: I1031 23:09:09.782637 32760 compaction.cc:880] memrowset(current size on disk: ~0 bytes) I1031 23:09:09.782652 32760 tablet.cc:913] T 3409046e569643c3a083c3f27cfe1582 P 23f962e4a1744381ad5fa0d2d8b10241: Memstore in-memory size: 763 bytes I1031 23:09:09.782678 32760 tablet.cc:1174] T 3409046e569643c3a083c3f27cfe1582 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6182758459659628544 or (T in {6182758459659628544})}] I1031 23:09:09.782816 32760 multi_column_writer.cc:85] Opened CFile writer for column ts[int32 NOT NULL] I1031 23:09:09.782852 32760 multi_column_writer.cc:85] Opened CFile writer for column id[int32 NOT NULL] I1031 23:09:09.976078 32760 tablet.cc:1259] T 3409046e569643c3a083c3f27cfe1582 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I1031 23:09:09.980132 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:09.980181 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.975s I1031 23:09:09.980232 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:09:09.980753 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:09:09.980775 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:09:09.980999 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:09:09.981045 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:09:09.981077 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:09.981279 30606 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.920s I1031 23:09:09.981299 30606 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:10.588021 32760 tablet.cc:1314] T 3409046e569643c3a083c3f27cfe1582 P 23f962e4a1744381ad5fa0d2d8b10241: Flush Phase 2: carrying over any updates which arrived during Phase 1 I1031 23:09:10.588146 32760 tablet.cc:1316] T 3409046e569643c3a083c3f27cfe1582 P 23f962e4a1744381ad5fa0d2d8b10241: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6182758459659628544 or (T in {6182758459659628544})}] I1031 23:09:11.561239 32760 tablet.cc:1358] T 3409046e569643c3a083c3f27cfe1582 P 23f962e4a1744381ad5fa0d2d8b10241: Flush successful on 4 rows (4325 bytes) I1031 23:09:11.561416 32760 maintenance_manager.cc:419] Time spent running FlushMRSOp(3409046e569643c3a083c3f27cfe1582): real 2.399s user 2.084s sys 0.005s I1031 23:09:11.561601 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: FlushMRSOp(3409046e569643c3a083c3f27cfe1582) metrics: {"cfile_init":1,"fdatasync":11,"fdatasync_us":296851,"lbm_read_time_us":7,"lbm_reads_lt_1ms":4,"lbm_write_time_us":145,"lbm_writes_lt_1ms":26,"tcmalloc_contention_cycles":342400} I1031 23:09:11.987593 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:11.987648 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.293s I1031 23:09:11.987707 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:09:11.988289 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:09:11.988327 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:09:11.988538 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:09:11.988590 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:09:11.988610 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:11.988857 30620 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.041s I1031 23:09:11.988878 30620 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:16.486675 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:16.486730 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.558s I1031 23:09:16.486783 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:09:16.487403 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:09:16.487428 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:09:16.487663 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:09:16.487711 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:09:16.487732 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:16.488028 30640 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.944s I1031 23:09:16.488047 30640 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:21.854383 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:21.854425 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.219s I1031 23:09:21.854485 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:09:21.855028 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:09:21.855063 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:09:21.855269 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:09:21.855310 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:09:21.855334 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:21.855548 30665 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.849s I1031 23:09:21.855576 30665 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:22.356118 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:22.356158 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.203s I1031 23:09:22.356199 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:22.356667 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:09:22.356703 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:09:22.356933 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:09:22.356974 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:09:22.356986 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:22.357450 30667 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.537s I1031 23:09:22.357472 30667 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:24.787109 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:24.787171 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.685s I1031 23:09:24.787226 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:09:24.787818 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:09:24.787855 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:09:24.788106 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:09:24.788133 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:09:24.788158 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:24.788470 30677 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.845s I1031 23:09:24.788496 30677 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:09:26.670730 30381 log.cc:565] Time spent T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.149s user 0.000s sys 0.000s W1031 23:09:26.670756 30386 log.cc:565] Time spent T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.219s user 0.000s sys 0.000s I1031 23:09:27.737440 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:27.737483 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.884s I1031 23:09:27.737537 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:27.738210 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:09:27.738240 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:09:27.738482 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:09:27.738528 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:09:27.738546 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:27.738867 30684 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.354s I1031 23:09:27.738890 30684 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:28.360893 32803 tablet_service.cc:691] Processing DeleteTablet for tablet f49a4f915ac048b096fcb5f4878f436d with delete_type TABLET_DATA_DELETED (Replaced by 56155a2adc24450d89e338cc955bfa18 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:28.383411 32803 tablet_service.cc:691] Processing DeleteTablet for tablet 80ba7f33ec864c5f96c61932edb5cdc4 with delete_type TABLET_DATA_DELETED (Replaced by 47eeb8448c454968a45bf1a984427b25 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:28.386862 32803 tablet_service.cc:691] Processing DeleteTablet for tablet 27f651ff46ca4722b064a85e795dcaa4 with delete_type TABLET_DATA_DELETED (Replaced by 46fc46e028434bc69f467922a9a59101 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:28.398325 32803 tablet_service.cc:691] Processing DeleteTablet for tablet 32984b820db347e1b2d4d0786cf221f2 with delete_type TABLET_DATA_DELETED (Replaced by eeb3a3cb417b466abffd16749d165a61 at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:28.444923 32803 tablet_service.cc:691] Processing DeleteTablet for tablet f0a40a8745bb4f4abbe8b304ebc7626c with delete_type TABLET_DATA_DELETED (Replaced by 802f72af09384e95acd389f46a1d9c84 at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:28.447346 32803 tablet_service.cc:691] Processing DeleteTablet for tablet 005a48fb466c4a52896842dd00124755 with delete_type TABLET_DATA_DELETED (Replaced by f2af422919fd4560bd6441509a68d64b at 2017-10-31 23:05:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:28.461704 32803 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:28.461736 32803 tablet_peer.cc:221] Initiating TabletPeer shutdown for tablet: 69b4b5f037014f10bfab077f3f98ca49 I1031 23:09:28.492910 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 5110f0095bd94f67abf0aad906332efe with delete_type TABLET_DATA_DELETED (Replaced by bff7dab34ccd4b42842077e82106f6fb at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:29.914530 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:29.914574 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.613s I1031 23:09:29.914635 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:09:29.915180 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:09:29.915216 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:09:29.915427 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:09:29.915518 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:09:29.915540 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:29.915792 30881 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.832s I1031 23:09:29.915829 30881 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:32.794590 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:32.794651 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.552s I1031 23:09:32.794704 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:09:32.795327 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:09:32.795364 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:09:32.795593 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:09:32.795702 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:09:32.795724 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:32.795843 30890 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.440s I1031 23:09:32.795864 30890 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:36.601217 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:36.601271 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.795s I1031 23:09:36.601325 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:09:36.601853 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:09:36.601884 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:09:36.602151 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:09:36.602185 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:09:36.602195 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:36.602560 30912 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.858s I1031 23:09:36.602586 30912 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:38.388643 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:38.388696 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.424s I1031 23:09:38.388754 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:09:38.389247 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:09:38.389274 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:09:38.389542 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:09:38.389585 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:09:38.389601 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:38.389788 30934 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.626s I1031 23:09:38.389816 30934 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:38.568507 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:38.568545 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.683s I1031 23:09:38.568590 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:09:38.569025 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:09:38.569047 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:09:38.569272 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:09:38.569324 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:09:38.569342 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:38.569602 30935 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.377s I1031 23:09:38.569623 30935 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:46.927129 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:46.927187 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.894s I1031 23:09:46.927248 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:46.927855 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:09:46.927896 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:09:46.928189 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:09:46.928267 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:09:46.928297 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:46.928702 30960 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.858s I1031 23:09:46.928724 30960 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:51.075034 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:51.075089 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.257s I1031 23:09:51.075141 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:09:51.075651 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:09:51.075696 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:09:51.075948 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:09:51.076031 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:09:51.076053 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:51.076409 30986 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.810s I1031 23:09:51.076431 30986 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:51.684998 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:51.685046 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.404s I1031 23:09:51.685093 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:09:51.685561 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:09:51.685582 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:09:51.685775 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:09:51.685910 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:09:51.685936 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:51.686538 30987 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.848s I1031 23:09:51.686561 30987 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:52.126404 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:52.126441 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.117s I1031 23:09:52.126485 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:09:52.126914 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:09:52.126947 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:09:52.127207 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:09:52.127259 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:09:52.127281 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:52.127460 30988 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.166s I1031 23:09:52.127480 30988 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:09:56.864621 30381 log.cc:565] Time spent T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.115s user 0.000s sys 0.000s W1031 23:09:56.864616 30391 log.cc:565] Time spent T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.062s user 0.000s sys 0.000s I1031 23:09:57.695013 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:57.695055 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.676s I1031 23:09:57.695108 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:09:57.695649 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:09:57.695685 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:09:57.695952 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:09:57.695999 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:09:57.696015 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:57.696308 31007 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.729s I1031 23:09:57.696337 31007 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:58.340684 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 4b81a7f36c9a4b24a3294e39fdf19d9d with delete_type TABLET_DATA_DELETED (Replaced by 1cebccaea10d49478c004cca39676556 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:58.402137 32815 tablet_service.cc:691] Processing DeleteTablet for tablet f2af422919fd4560bd6441509a68d64b with delete_type TABLET_DATA_DELETED (Replaced by a17da97943904920814af1508905ecfc at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:58.413763 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 46fc46e028434bc69f467922a9a59101 with delete_type TABLET_DATA_DELETED (Replaced by 7d1359dc00a24df68d41c2447e367f1d at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:58.441736 32815 tablet_service.cc:691] Processing DeleteTablet for tablet b758ec3274c84dcbb110cf5aa3dca9aa with delete_type TABLET_DATA_DELETED (Replaced by 8356b43879104775b9a8c5a9e546e85b at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:58.446152 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 012b21c0f95e4dd594076018fd6fdb7e with delete_type TABLET_DATA_DELETED (Replaced by ae7fa26c77054ef1b98d5e0f4e6940d6 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:58.463716 32815 tablet_service.cc:691] Processing DeleteTablet for tablet d67c8d7da92f4f10b75858f21d80f8c4 with delete_type TABLET_DATA_DELETED (Replaced by 8566e0c79e674a74803cd1a15fec8cb2 at 2017-10-31 23:05:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:58.468178 32815 tablet_service.cc:691] Processing DeleteTablet for tablet bff7dab34ccd4b42842077e82106f6fb with delete_type TABLET_DATA_DELETED (Replaced by 005a48fb466c4a52896842dd00124755 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:58.470859 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:58.470902 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.213s I1031 23:09:58.470952 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:09:58.471458 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:09:58.471482 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:09:58.471757 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:09:58.471799 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:09:58.471809 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:58.472379 31026 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.858s I1031 23:09:58.472399 31026 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:09:58.479581 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 0ea66c65e2d4445eb9cc83ba7ee1448b with delete_type TABLET_DATA_DELETED (Replaced by 32984b820db347e1b2d4d0786cf221f2 at 2017-10-31 23:04:52 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:09:59.695884 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:09:59.695942 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.655s I1031 23:09:59.696003 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:09:59.696796 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:09:59.696833 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:09:59.697054 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:09:59.697178 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:09:59.697201 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:09:59.697437 31028 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.319s I1031 23:09:59.697458 31028 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:03.438477 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:03.438518 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.034s I1031 23:10:03.438567 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:10:03.439164 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:10:03.439190 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:10:03.439432 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:10:03.439481 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:10:03.439502 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:03.439716 31043 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.710s I1031 23:10:03.439738 31043 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:04.881460 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:04.881503 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.967s I1031 23:10:04.881549 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:10:04.882202 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:10:04.882225 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:10:04.882421 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:10:04.882529 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:10:04.882552 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:04.882728 31046 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.869s I1031 23:10:04.882748 31046 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:10.512406 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:10.512461 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.846s I1031 23:10:10.512513 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:10:10.513023 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:10:10.513046 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:10:10.513314 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:10:10.513339 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:10:10.513356 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:10.513630 31081 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.523s I1031 23:10:10.513656 31081 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:13.260033 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:13.260087 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.700s I1031 23:10:13.260139 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:10:13.260689 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:10:13.260725 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:10:13.260941 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:10:13.261013 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:10:13.261034 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:13.261219 31091 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.803s I1031 23:10:13.261245 31091 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:13.358484 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:13.358520 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.997s I1031 23:10:13.358557 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:10:13.358989 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:10:13.359026 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:10:13.359308 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:10:13.359347 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:10:13.359355 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:13.359606 31094 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.493s I1031 23:10:13.359628 31094 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:19.144706 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:19.144752 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.432s I1031 23:10:19.144809 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:10:19.145473 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:10:19.145500 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:10:19.145633 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:10:19.145675 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:10:19.145696 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:19.145822 31149 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.152s I1031 23:10:19.145843 31149 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:19.877586 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:19.877624 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.848s I1031 23:10:19.877662 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:10:19.878108 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:10:19.878149 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:10:19.878409 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:10:19.878439 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:10:19.878456 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:19.878952 31156 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.612s I1031 23:10:19.878976 31156 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:21.939576 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:21.939635 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.427s I1031 23:10:21.939688 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:10:21.940270 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:10:21.940294 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:10:21.940551 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:10:21.940592 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:10:21.940599 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:21.940966 31165 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.390s I1031 23:10:21.940991 31165 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:22.806126 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:22.806167 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.745s I1031 23:10:22.806207 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:10:22.806638 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:10:22.806680 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:10:22.806947 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:10:22.807039 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:10:22.807060 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:22.807495 31168 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.431s I1031 23:10:22.807521 31168 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:22.938426 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:22.938463 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.013s I1031 23:10:22.938499 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:10:22.938987 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:10:22.939018 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:10:22.939206 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:10:22.939239 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:10:22.939252 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:22.939601 31169 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.160s I1031 23:10:22.939621 31169 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:26.864830 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:26.864882 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.931s I1031 23:10:26.864930 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:10:26.865397 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:10:26.865434 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:10:26.865710 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:10:26.865754 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:10:26.865775 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:26.865988 31182 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.986s I1031 23:10:26.866034 31182 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:10:27.415451 30396 log.cc:565] Time spent T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.205s user 0.000s sys 0.000s I1031 23:10:27.875090 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:27.875146 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.780s I1031 23:10:27.875212 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:10:27.875730 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:10:27.875754 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:10:27.875982 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:10:27.876061 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:10:27.876083 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:27.876261 31186 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.492s I1031 23:10:27.876284 31186 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:30.104099 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:30.104148 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.749s I1031 23:10:30.104208 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:10:30.104729 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:10:30.104770 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:10:30.104979 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:10:30.105152 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:10:30.105173 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:30.105358 31391 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.181s I1031 23:10:30.105378 31391 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:32.382194 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:32.382243 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.894s I1031 23:10:32.382293 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:10:32.382910 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:10:32.382946 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:10:32.383154 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:10:32.383203 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:10:32.383221 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:32.383522 31408 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.577s I1031 23:10:32.383548 31408 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:36.538723 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:36.538784 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.841s I1031 23:10:36.538833 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:10:36.539338 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:10:36.539373 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:10:36.539597 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:10:36.539621 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:10:36.539641 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:36.540032 31421 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.166s I1031 23:10:36.540060 31421 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:36.706398 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:36.706424 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.576s I1031 23:10:36.706478 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:10:36.706955 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:10:36.707012 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:10:36.707290 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:10:36.707365 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:10:36.707391 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:36.707828 31422 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.669s I1031 23:10:36.707847 31422 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:38.605895 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:38.605947 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.488s I1031 23:10:38.606016 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:10:38.606636 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:10:38.606673 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:10:38.606956 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:10:38.606981 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:10:38.607009 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:38.607205 31444 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.435s I1031 23:10:38.607244 31444 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:39.868420 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:39.868466 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.263s I1031 23:10:39.868513 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:10:39.868984 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:10:39.869035 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:10:39.869204 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:10:39.869307 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:10:39.869329 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:39.869508 31449 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.446s I1031 23:10:39.869529 31449 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:43.000725 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:43.000780 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.107s I1031 23:10:43.000833 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:10:43.001366 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:10:43.001390 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:10:43.001679 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:10:43.001708 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:10:43.001729 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:43.001924 31457 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.747s I1031 23:10:43.001950 31457 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:47.423859 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:47.423913 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.338s I1031 23:10:47.423962 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:10:47.424561 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:10:47.424607 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:10:47.424899 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:10:47.424931 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:10:47.424953 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:47.425325 31475 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.018s I1031 23:10:47.425351 31475 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:52.649920 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:52.649962 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.328s I1031 23:10:52.650029 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:10:52.650540 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:10:52.650564 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:10:52.650692 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:10:52.650718 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:10:52.650734 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:52.651021 31508 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.835s I1031 23:10:52.651046 31508 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:54.901479 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:54.901528 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.958s I1031 23:10:54.901584 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:10:54.902158 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:10:54.902194 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:10:54.902400 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:10:54.902523 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:10:54.902544 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:54.902844 31518 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.102s I1031 23:10:54.902865 31518 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:57.037694 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:10:57.037745 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.927s I1031 23:10:57.037796 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:10:57.038408 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:10:57.038446 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:10:57.038715 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:10:57.038864 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:10:57.038888 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:10:57.039132 31528 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.151s I1031 23:10:57.039155 31528 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:10:58.463951 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:11:01.226657 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:01.226711 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.412s I1031 23:11:01.226759 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:11:01.227277 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:11:01.227319 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:11:01.227531 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:11:01.227578 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:11:01.227597 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:01.227839 31560 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.486s I1031 23:11:01.227877 31560 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:02.357647 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:02.357697 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.684s I1031 23:11:02.357748 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:11:02.358222 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:11:02.358258 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:11:02.358541 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:11:02.358587 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:11:02.358598 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:02.358794 31562 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.307s I1031 23:11:02.358820 31562 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:02.419194 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:02.419232 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.820s I1031 23:11:02.419270 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:11:02.419706 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:11:02.419741 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:11:02.419945 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:11:02.420063 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:11:02.420085 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:02.420517 31565 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.971s I1031 23:11:02.420538 31565 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:12.013207 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:12.013258 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.166s I1031 23:11:12.013308 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:11:12.013813 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:11:12.013849 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:11:12.014086 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:11:12.014152 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:11:12.014166 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:12.014292 31652 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.073s I1031 23:11:12.014320 31652 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:12.727056 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:12.727104 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.276s I1031 23:11:12.727164 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:11:12.727766 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:11:12.727789 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:11:12.728034 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:11:12.728061 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:11:12.728085 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:12.728550 31657 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.986s I1031 23:11:12.728574 31657 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:11:12.741575 30396 log.cc:565] Time spent T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.167s user 0.000s sys 0.000s W1031 23:11:12.741613 30386 log.cc:565] Time spent T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.125s user 0.000s sys 0.000s I1031 23:11:13.012503 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:13.012554 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.669s I1031 23:11:13.012614 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:11:13.013097 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:11:13.013134 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:11:13.013380 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:11:13.013424 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:11:13.013443 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:13.013638 31659 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.417s I1031 23:11:13.013659 31659 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:13.624094 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:13.624122 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.521s I1031 23:11:13.624173 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:11:13.624624 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:11:13.624650 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:11:13.624896 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:11:13.624933 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:11:13.624953 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:13.625540 31663 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.841s I1031 23:11:13.625563 31663 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:18.125778 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:18.125824 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.752s I1031 23:11:18.125881 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:11:18.126473 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:11:18.126502 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:11:18.126725 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:11:18.126773 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:11:18.126793 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:18.126978 31853 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.507s I1031 23:11:18.126998 31853 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:24.470952 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:24.471001 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.936s I1031 23:11:24.471058 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:11:24.471729 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:11:24.471758 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:11:24.472003 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:11:24.472088 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:11:24.472120 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:24.472595 31878 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.825s I1031 23:11:24.472615 31878 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:25.931118 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:25.931157 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.059s I1031 23:11:25.931211 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:11:25.931751 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:11:25.931778 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:11:25.932092 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:11:25.932133 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:11:25.932152 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:25.932291 31883 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.333s I1031 23:11:25.932313 31883 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:27.035900 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:27.035948 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.336s I1031 23:11:27.036018 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:11:27.036576 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:11:27.036604 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:11:27.036793 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:11:27.036931 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:11:27.036980 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:27.037098 31889 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.721s I1031 23:11:27.037119 31889 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:31.457373 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:31.457422 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.642s I1031 23:11:31.457478 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:11:31.458236 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:11:31.458276 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:11:31.458453 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:11:31.458504 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:11:31.458524 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:31.458719 32141 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.722s I1031 23:11:31.458744 32141 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:34.284363 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:34.284404 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.902s I1031 23:11:34.284459 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:11:34.284977 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:11:34.285022 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:11:34.285295 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:11:34.285328 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:11:34.285347 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:34.285533 32148 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.987s I1031 23:11:34.285559 32148 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:38.961545 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:38.961592 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.761s I1031 23:11:38.961650 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:11:38.962165 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:11:38.962193 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:11:38.962433 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:11:38.962482 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:11:38.962502 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:38.962693 32198 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.356s I1031 23:11:38.962723 32198 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:42.124792 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:42.124833 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.367s I1031 23:11:42.124891 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:11:42.125427 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:11:42.125461 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:11:42.125743 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:11:42.125870 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:11:42.125900 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:42.126191 32227 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.858s I1031 23:11:42.126212 32227 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:43.921813 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:43.921864 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.191s I1031 23:11:43.921933 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:11:43.922547 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:11:43.922576 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:11:43.922822 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:11:43.922875 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:11:43.922912 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:43.923146 32234 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.943s I1031 23:11:43.923171 32234 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:44.709969 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:44.710013 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.825s I1031 23:11:44.710070 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:11:44.710737 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:11:44.710772 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:11:44.711002 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:11:44.711159 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:11:44.711176 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:44.711508 32238 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.919s I1031 23:11:44.711531 32238 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:44.896379 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:44.896407 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.706s I1031 23:11:44.896448 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:11:44.896929 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:11:44.896963 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:11:44.897219 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:11:44.897325 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:11:44.897348 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:44.897536 32239 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.397s I1031 23:11:44.897557 32239 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:11:48.259341 30396 log.cc:565] Time spent T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.131s user 0.000s sys 0.000s I1031 23:11:49.200937 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:49.200978 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.991s I1031 23:11:49.201048 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:11:49.201547 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:11:49.201575 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:11:49.201750 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:11:49.201798 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:11:49.201814 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:49.202014 32273 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.451s I1031 23:11:49.202039 32273 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:49.549677 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:49.549705 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.958s I1031 23:11:49.549744 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:11:49.550148 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:11:49.550177 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:11:49.550375 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:11:49.550506 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:11:49.550528 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:49.550839 32276 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.837s I1031 23:11:49.550860 32276 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:53.457031 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:53.457079 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.348s I1031 23:11:53.457170 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:11:53.457770 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:11:53.457805 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:11:53.458053 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:11:53.458107 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:11:53.458135 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:53.458463 32285 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.968s I1031 23:11:53.458493 32285 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:11:58.468439 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:11:59.502184 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:11:59.502225 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.741s I1031 23:11:59.502300 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:11:59.502895 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:11:59.502923 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:11:59.503115 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:11:59.503216 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:11:59.503238 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:11:59.503489 32344 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.927s I1031 23:11:59.503512 32344 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:00.592877 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:00.592917 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.403s I1031 23:12:00.592972 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:12:00.593485 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:12:00.593511 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:12:00.593731 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:12:00.593840 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:12:00.593865 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:00.594045 32347 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.668s I1031 23:12:00.594065 32347 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:02.309504 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:02.309550 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.554s I1031 23:12:02.309605 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:12:02.310093 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:12:02.310127 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:12:02.310482 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:12:02.310534 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:12:02.310554 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:02.310683 32360 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.190s I1031 23:12:02.310703 32360 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:06.082926 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:06.082974 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.893s I1031 23:12:06.083040 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:12:06.083572 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:12:06.083601 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:12:06.083842 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:12:06.083901 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:12:06.083936 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:06.084362 32386 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.315s I1031 23:12:06.084383 32386 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:06.163378 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:06.163424 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.336s I1031 23:12:06.163480 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:12:06.164031 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:12:06.164059 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:12:06.164234 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:12:06.164266 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:12:06.164291 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:06.164633 32387 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.794s I1031 23:12:06.164654 32387 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:07.088140 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:07.088178 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.837s I1031 23:12:07.088243 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:12:07.088778 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:12:07.088807 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:12:07.088973 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:12:07.089143 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:12:07.089164 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:07.089406 32388 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.683s I1031 23:12:07.089426 32388 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:14.515022 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:14.515070 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.893s I1031 23:12:14.515143 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:12:14.515748 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:12:14.515771 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:12:14.515995 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:12:14.517971 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:12:14.517992 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:14.518311 32439 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.729s I1031 23:12:14.518329 32439 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:14.544464 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:14.544499 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.446s I1031 23:12:14.544540 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:12:14.544939 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:12:14.544966 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:12:14.545229 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:12:14.545264 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:12:14.545285 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:14.545537 32440 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.747s I1031 23:12:14.545558 32440 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:15.158113 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:15.158151 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.227s I1031 23:12:15.158224 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:12:15.158812 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:12:15.158841 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:12:15.158989 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:12:15.159035 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:12:15.159054 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:15.159549 32443 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.842s I1031 23:12:15.159569 32443 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:18.354327 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:18.354372 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.541s I1031 23:12:18.354429 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:12:18.354925 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:12:18.354954 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:12:18.355096 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:12:18.355427 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:12:18.355448 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:18.355813 32471 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.253s I1031 23:12:18.355840 32471 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:20.173015 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:20.173058 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.635s I1031 23:12:20.173121 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:12:20.173650 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:12:20.173677 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:12:20.173910 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:12:20.173940 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:12:20.173964 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:20.174212 32480 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.767s I1031 23:12:20.174237 32480 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:20.193269 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:20.193295 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.210s I1031 23:12:20.193330 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:12:20.193764 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:12:20.193795 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:12:20.193987 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:12:20.194034 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:12:20.194046 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:20.194169 32481 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.415s I1031 23:12:20.194188 32481 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:22.029036 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:22.029088 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.443s I1031 23:12:22.029141 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:12:22.029690 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:12:22.029718 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:12:22.029922 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:12:22.030103 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:12:22.030133 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:22.030306 32489 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.841s I1031 23:12:22.030328 32489 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:12:23.549445 30386 log.cc:565] Time spent T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.178s user 0.000s sys 0.000s W1031 23:12:23.549453 30391 log.cc:565] Time spent T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.136s user 0.000s sys 0.000s W1031 23:12:23.549511 30381 log.cc:565] Time spent T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.147s user 0.000s sys 0.000s I1031 23:12:27.640080 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:27.640128 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.342s I1031 23:12:27.640187 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:12:27.640682 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:12:27.640718 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:12:27.640966 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:12:27.640993 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:12:27.641021 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:27.641687 32510 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.341s I1031 23:12:27.641726 32510 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:28.824728 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:28.824784 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.839s I1031 23:12:28.824836 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:12:28.825336 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:12:28.825373 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:12:28.825601 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:12:28.825661 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:12:28.825681 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:28.825860 32720 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.178s I1031 23:12:28.825880 32720 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:33.424495 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:33.424556 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.035s I1031 23:12:33.424608 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:12:33.425127 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:12:33.425151 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:12:33.425348 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:12:33.425400 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:12:33.425420 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:33.425982 32768 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.380s I1031 23:12:33.426002 32768 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:35.206598 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:35.206650 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.065s I1031 23:12:35.206701 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:12:35.207242 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:12:35.207267 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:12:35.207527 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:12:35.207566 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:12:35.207577 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:35.208097 32902 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.155s I1031 23:12:35.208125 32902 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:35.695518 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:35.695557 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.170s I1031 23:12:35.695595 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:12:35.696034 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:12:35.696063 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:12:35.696205 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:12:35.696327 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:12:35.696348 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:35.696545 32903 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.181s I1031 23:12:35.696565 32903 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:38.634289 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:38.634343 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.639s I1031 23:12:38.634408 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:12:38.634893 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:12:38.634930 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:12:38.635190 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:12:38.635265 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:12:38.635288 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:38.635797 32933 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.477s I1031 23:12:38.635824 32933 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:41.532773 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:41.532829 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.547s I1031 23:12:41.532881 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:12:41.533390 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:12:41.533430 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:12:41.533694 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:12:41.533735 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:12:41.533749 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:41.533975 32936 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.412s I1031 23:12:41.534008 32936 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:46.530356 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:46.530418 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.641s I1031 23:12:46.530477 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:12:46.530941 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:12:46.530973 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:12:46.531209 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:12:46.531261 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:12:46.531280 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:46.531692 32950 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.112s I1031 23:12:46.531713 32950 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:48.944080 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:48.944133 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.450s I1031 23:12:48.944186 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:12:48.944754 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:12:48.944790 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:12:48.945039 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:12:48.945080 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:12:48.945092 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:48.945351 32978 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.562s I1031 23:12:48.945379 32978 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:12:54.121390 30396 log.cc:565] Time spent T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.175s user 0.000s sys 0.000s I1031 23:12:56.499017 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:56.499071 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.741s I1031 23:12:56.499124 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:12:56.499785 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:12:56.499820 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:12:56.500077 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:12:56.500183 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:12:56.500210 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:56.500742 33003 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.577s I1031 23:12:56.500763 33003 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:56.740855 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:56.740892 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.423s I1031 23:12:56.740931 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:12:56.741411 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:12:56.741443 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:12:56.741688 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:12:56.741767 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:12:56.741789 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:56.742118 33004 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.387s I1031 23:12:56.742138 33004 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:57.488730 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:57.488780 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.353s I1031 23:12:57.488833 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:12:57.489382 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:12:57.489431 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:12:57.489660 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:12:57.489686 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:12:57.489704 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:57.489895 33007 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.420s I1031 23:12:57.489919 33007 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:57.741747 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:12:57.741786 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.781s I1031 23:12:57.741823 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:12:57.742272 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:12:57.742297 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:12:57.742547 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:12:57.742581 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:12:57.742606 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:12:57.742729 33009 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.678s I1031 23:12:57.742753 33009 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:12:58.510773 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:13:01.208547 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:01.208603 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.371s I1031 23:13:01.208653 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:13:01.209214 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:13:01.209239 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:13:01.209434 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:13:01.209481 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:13:01.209501 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:01.209688 33036 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.482s I1031 23:13:01.209709 33036 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:03.273799 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:03.273851 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.515s I1031 23:13:03.273908 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:13:03.274606 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:13:03.274638 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:13:03.274893 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:13:03.274933 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:13:03.274941 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:03.275096 33048 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.344s I1031 23:13:03.275126 33048 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:07.095767 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:07.095818 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.713s I1031 23:13:07.095866 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:13:07.096515 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:13:07.096539 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:13:07.096761 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:13:07.096899 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:13:07.096920 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:07.097115 33058 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.716s I1031 23:13:07.097141 33058 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:10.654000 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:10.654054 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.311s I1031 23:13:10.654109 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:13:10.654711 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:13:10.654747 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:13:10.654994 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:13:10.655040 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:13:10.655058 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:10.655416 33083 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.402s I1031 23:13:10.655443 33083 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:12.604857 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:12.604900 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.924s I1031 23:13:12.604950 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:13:12.605409 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:13:12.605438 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:13:12.605698 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:13:12.605746 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:13:12.605767 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:12.605903 33096 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.414s I1031 23:13:12.605924 33096 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:13.957448 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:13.957490 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.166s I1031 23:13:13.957546 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:13:13.958118 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:13:13.958145 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:13:13.958387 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:13:13.958431 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:13:13.958443 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:13.958636 33104 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.564s I1031 23:13:13.958660 33104 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:14.225667 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:14.225695 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.971s I1031 23:13:14.225736 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:13:14.226336 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:13:14.226368 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:13:14.226529 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:13:14.226699 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:13:14.226719 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:14.226972 33108 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.852s I1031 23:13:14.226991 33108 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:15.175384 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:15.175426 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.959s I1031 23:13:15.175480 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:13:15.175985 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:13:15.176017 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:13:15.176151 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:13:15.176266 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:13:15.176288 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:15.176416 33115 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.580s I1031 23:13:15.176443 33115 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:18.838402 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:18.838449 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.357s I1031 23:13:18.838515 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:13:18.839226 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:13:18.839253 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:13:18.839404 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:13:18.839485 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:13:18.839515 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:18.839650 33145 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.831s I1031 23:13:18.839681 33145 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:19.719633 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:19.719676 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.320s I1031 23:13:19.719728 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:13:19.720238 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:13:19.720276 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:13:19.720511 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:13:19.720546 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:13:19.720564 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:19.720834 33148 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.615s I1031 23:13:19.720856 33148 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:21.808725 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:21.808760 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.233s I1031 23:13:21.808815 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:13:21.809286 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:13:21.809315 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:13:21.809545 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:13:21.809604 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:13:21.809624 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:21.809749 33157 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.740s I1031 23:13:21.809769 33157 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:22.765640 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:22.765686 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.275s I1031 23:13:22.765740 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:13:22.766315 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:13:22.766343 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:13:22.766484 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:13:22.766624 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:13:22.766645 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:22.766990 33162 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.050s I1031 23:13:22.767019 33162 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:23.594175 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:23.594207 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.593s I1031 23:13:23.594254 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:13:23.594825 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:13:23.594851 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:13:23.595044 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:13:23.595130 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:13:23.595151 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:23.595289 33165 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.525s I1031 23:13:23.595312 33165 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:24.100828 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:24.100857 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.006s I1031 23:13:24.100908 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:13:24.101454 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:13:24.101480 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:13:24.101649 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:13:24.101685 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:13:24.101699 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:24.101824 33169 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.480s I1031 23:13:24.101845 33169 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:29.056327 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:29.056375 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.735s I1031 23:13:29.056442 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:13:29.057010 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:13:29.057051 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:13:29.057217 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:13:29.057265 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:13:29.057286 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:29.057554 33378 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.253s I1031 23:13:29.057575 33378 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:13:29.169188 30396 log.cc:565] Time spent T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.065s user 0.000s sys 0.000s I1031 23:13:30.614817 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:30.614859 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.410s I1031 23:13:30.614902 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:13:30.615439 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:13:30.615476 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:13:30.615689 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:13:30.615813 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:13:30.615834 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:30.615955 33383 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.377s I1031 23:13:30.615972 33383 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:33.267019 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:33.267073 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.190s I1031 23:13:33.267125 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:13:33.267673 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:13:33.267698 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:13:33.267954 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:13:33.268005 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:13:33.268018 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:33.268255 33396 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.070s I1031 23:13:33.268275 33396 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:34.552302 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:34.552354 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.069s I1031 23:13:34.552418 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:13:34.552932 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:13:34.552958 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:13:34.553186 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:13:34.553364 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:13:34.553386 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:34.553586 33408 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.060s I1031 23:13:34.553613 33408 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:40.021085 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:40.021134 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.173s I1031 23:13:40.021189 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:13:40.021756 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:13:40.021795 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:13:40.022027 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:13:40.022088 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:13:40.022106 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:40.022236 33446 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.255s I1031 23:13:40.022264 33446 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:44.262234 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:44.262285 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.110s I1031 23:13:44.262341 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:13:44.262930 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:13:44.262959 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:13:44.263195 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:13:44.263228 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:13:44.263240 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:44.263433 33464 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.690s I1031 23:13:44.263474 33464 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:47.052948 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:47.053000 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.131s I1031 23:13:47.053058 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:13:47.053633 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:13:47.053661 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:13:47.053905 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:13:47.053966 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:13:47.053987 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:47.054179 33472 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.476s I1031 23:13:47.054199 33472 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:50.626775 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:50.626816 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.013s I1031 23:13:50.626880 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:13:50.627413 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:13:50.627439 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:13:50.627627 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:13:50.627697 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:13:50.627727 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:50.627984 33497 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.334s I1031 23:13:50.628029 33497 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:51.762796 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:51.762840 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.046s I1031 23:13:51.762897 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:13:51.763448 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:13:51.763478 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:13:51.763727 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:13:51.763859 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:13:51.763880 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:51.764122 33499 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.859s I1031 23:13:51.764142 33499 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:52.990175 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:52.990209 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.846s I1031 23:13:52.990257 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:13:52.990721 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:13:52.990748 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:13:52.991046 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:13:52.991103 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:13:52.991114 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:52.991294 33501 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.061s I1031 23:13:52.991314 33501 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:56.527245 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:13:56.527290 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.766s I1031 23:13:56.527350 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:13:56.527890 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:13:56.527918 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:13:56.528149 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:13:56.528241 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:13:56.528262 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:13:56.528450 33511 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.153s I1031 23:13:56.528470 33511 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:13:58.547816 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:14:00.576954 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:00.577016 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.821s I1031 23:14:00.577075 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:14:00.577633 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:14:00.577661 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:14:00.577925 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:14:00.577975 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:14:00.577996 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:00.578232 33538 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.765s I1031 23:14:00.578263 33538 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:00.697639 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:00.697667 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.050s I1031 23:14:00.697707 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:14:00.698266 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:14:00.698292 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:14:00.698505 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:14:00.698552 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:14:00.698573 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:00.699044 33539 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.648s I1031 23:14:00.699065 33539 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:00.808689 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:00.808717 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.894s I1031 23:14:00.808766 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:14:00.809221 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:14:00.809247 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:14:00.809514 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:14:00.809553 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:14:00.809573 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:00.810114 33540 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.415s I1031 23:14:00.810135 33540 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:00.828016 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:00.828043 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.424s I1031 23:14:00.828084 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:14:00.828527 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:14:00.828554 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:14:00.828730 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:14:00.828948 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:14:00.828970 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:00.829289 33541 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.397s I1031 23:14:00.829310 33541 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:04.602814 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:04.602860 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.018s I1031 23:14:04.602924 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:14:04.603554 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:14:04.603580 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:14:04.603809 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:14:04.603855 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:14:04.603868 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:04.604138 33560 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.380s I1031 23:14:04.604171 33560 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:05.144917 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:05.144948 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.597s I1031 23:14:05.145012 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:14:05.145458 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:14:05.145491 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:14:05.145731 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:14:05.145798 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:14:05.145820 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:05.146190 33562 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.860s I1031 23:14:05.146211 33562 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:05.907425 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:05.907456 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.655s I1031 23:14:05.907501 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:14:05.908032 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:14:05.908059 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:14:05.908298 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:14:05.908330 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:14:05.908352 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:05.908545 33566 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.790s I1031 23:14:05.908567 33566 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:07.129576 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:07.129616 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.000s I1031 23:14:07.129670 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:14:07.130240 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:14:07.130270 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:14:07.130520 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:14:07.130564 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:14:07.130581 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:07.130705 33575 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.561s I1031 23:14:07.130725 33575 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:11.425102 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:11.425146 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.219s I1031 23:14:11.425231 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:14:11.425804 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:14:11.425832 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:14:11.426129 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:14:11.426182 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:14:11.426201 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:11.426488 33604 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.223s I1031 23:14:11.426508 33604 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:18.697919 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:18.697971 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.936s I1031 23:14:18.698041 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:14:18.698520 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:14:18.698547 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:14:18.698726 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:14:18.698797 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:14:18.698827 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:18.699275 33648 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.479s I1031 23:14:18.699309 33648 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:19.480253 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:19.480299 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.806s I1031 23:14:19.480357 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:14:19.480908 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:14:19.480938 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:14:19.481092 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:14:19.481307 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:14:19.481328 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:19.481670 33651 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.487s I1031 23:14:19.481690 33651 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:21.057598 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:21.057631 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.527s I1031 23:14:21.057695 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:14:21.058185 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:14:21.058212 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:14:21.058452 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:14:21.058499 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:14:21.058511 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:21.058694 33658 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.572s I1031 23:14:21.058718 33658 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:24.242933 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:24.242995 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.574s I1031 23:14:24.243048 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:14:24.243551 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:14:24.243580 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:14:24.243775 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:14:24.243799 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:14:24.243816 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:24.244015 33672 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.291s I1031 23:14:24.244042 33672 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:29.731482 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:29.731534 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.934s I1031 23:14:29.731588 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:14:29.732141 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:14:29.732169 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:14:29.732409 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:14:29.732475 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:14:29.732735 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:29.733101 33894 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.331s I1031 23:14:29.733124 33894 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:30.782791 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:30.782824 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.724s I1031 23:14:30.782877 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:14:30.783378 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:14:30.783404 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:14:30.783656 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:14:30.783702 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:14:30.783721 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:30.783901 33900 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.178s I1031 23:14:30.783922 33900 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:31.406754 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:31.406785 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.906s I1031 23:14:31.406828 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:14:31.407289 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:14:31.407315 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:14:31.407552 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:14:31.407588 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:14:31.407606 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:31.408085 33904 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.315s I1031 23:14:31.408108 33904 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:32.991869 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:32.991911 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.856s I1031 23:14:32.991973 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:14:32.992545 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:14:32.992584 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:14:32.992795 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:14:32.992875 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:14:32.992902 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:32.993113 33906 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.401s I1031 23:14:32.993134 33906 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:33.529170 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:33.529199 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.249s I1031 23:14:33.529258 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:14:33.529724 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:14:33.529750 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:14:33.530019 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:14:33.530078 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:14:33.530099 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:33.530297 33913 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.675s I1031 23:14:33.530319 33913 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:38.034518 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:38.034564 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.496s I1031 23:14:38.034623 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:14:38.035142 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:14:38.035171 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:14:38.035423 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:14:38.035465 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:14:38.035480 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:38.035610 33941 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.726s I1031 23:14:38.035640 33941 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:38.062499 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:38.062533 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.995s I1031 23:14:38.062574 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:14:38.063052 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:14:38.063081 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:14:38.063278 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:14:38.063434 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:14:38.063455 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:38.063844 33944 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.340s I1031 23:14:38.063864 33944 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:46.191359 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:46.191402 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.345s I1031 23:14:46.191457 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:14:46.191982 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:14:46.192028 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:14:46.192304 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:14:46.192339 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:14:46.192350 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:46.192545 33966 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.058s I1031 23:14:46.192571 33966 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:47.997560 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:47.997608 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.368s I1031 23:14:47.997666 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:14:47.998224 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:14:47.998258 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:14:47.998499 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:14:47.998566 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:14:47.998587 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:47.998839 33988 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.427s I1031 23:14:47.998859 33988 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:48.080899 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:48.080926 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.110s I1031 23:14:48.080968 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:14:48.081405 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:14:48.081434 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:14:48.081634 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:14:48.081703 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:14:48.081720 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:48.082283 33989 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.886s I1031 23:14:48.082304 33989 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:50.361979 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:50.362022 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.261s I1031 23:14:50.362073 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:14:50.362584 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:14:50.362612 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:14:50.362859 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:14:50.362959 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:14:50.362982 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:50.363188 33997 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.456s I1031 23:14:50.363215 33997 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:52.218930 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:52.218983 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.241s I1031 23:14:52.219056 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:14:52.219529 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:14:52.219555 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:14:52.219807 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:14:52.219858 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:14:52.219877 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:52.220173 34007 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.728s I1031 23:14:52.220194 34007 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:54.579761 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:54.579803 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.848s I1031 23:14:54.579857 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:14:54.580404 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:14:54.580448 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:14:54.580716 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:14:54.580765 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:14:54.580782 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:54.581156 34015 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.125s I1031 23:14:54.581184 34015 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:55.743387 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:14:55.743432 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.030s I1031 23:14:55.743477 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:14:55.743952 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:14:55.743978 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:14:55.744247 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:14:55.744392 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:14:55.744422 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:14:55.744599 34022 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.976s I1031 23:14:55.744618 34022 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:14:58.586036 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:15:00.777268 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:00.777315 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.085s I1031 23:15:00.777379 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:15:00.777936 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:15:00.777964 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:15:00.778153 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:15:00.778188 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:15:00.778200 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:00.778398 34055 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.725s I1031 23:15:00.778448 34055 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:01.634256 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:01.634286 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.321s I1031 23:15:01.634332 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:15:01.634798 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:15:01.634824 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:15:01.635071 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:15:01.635120 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:15:01.635143 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:01.635270 34060 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.477s I1031 23:15:01.635294 34060 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:02.605720 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:02.605774 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.256s I1031 23:15:02.605829 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:15:02.606312 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:15:02.606338 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:15:02.606632 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:15:02.606662 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:15:02.606683 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:02.606935 34072 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.904s I1031 23:15:02.606961 34072 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:04.101639 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:04.101680 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.144s I1031 23:15:04.101742 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:15:04.102298 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:15:04.102326 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:15:04.102614 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:15:04.102685 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:15:04.102711 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:04.102840 34079 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.048s I1031 23:15:04.102860 34079 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:06.320834 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:06.320870 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.440s I1031 23:15:06.320924 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:15:06.321485 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:15:06.321511 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:15:06.321753 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:15:06.321791 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:15:06.321811 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:06.322095 34090 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.294s I1031 23:15:06.322121 34090 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:10.661037 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:10.661082 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.837s I1031 23:15:10.661147 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:15:10.661681 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:15:10.661710 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:15:10.662003 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:15:10.662046 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:15:10.662067 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:10.662444 34121 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.028s I1031 23:15:10.662466 34121 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:10.903304 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:10.903332 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.574s I1031 23:15:10.903374 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:15:10.903822 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:15:10.903858 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:15:10.904090 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:15:10.904151 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:15:10.904173 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:10.904364 34122 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.366s I1031 23:15:10.904386 34122 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:13.289567 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:13.289615 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.389s I1031 23:15:13.289681 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:15:13.290194 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:15:13.290222 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:15:13.290503 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:15:13.290570 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:15:13.290585 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:13.290931 34134 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.946s I1031 23:15:13.290957 34134 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:13.781036 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:13.781065 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.785s I1031 23:15:13.781116 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:15:13.781541 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:15:13.781569 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:15:13.781729 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:15:13.781837 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:15:13.781859 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:13.782289 34137 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.106s I1031 23:15:13.782310 34137 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:14.735828 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:14.735877 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.602s I1031 23:15:14.735926 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:15:14.736418 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:15:14.736443 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:15:14.736683 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:15:14.736770 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:15:14.736790 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:14.737011 34145 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.432s I1031 23:15:14.737066 34145 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:17.073747 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:17.073789 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.208s I1031 23:15:17.073848 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:15:17.074364 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:15:17.074393 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:15:17.074635 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:15:17.074739 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:15:17.074770 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:17.074971 34154 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.031s I1031 23:15:17.075019 34154 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:24.810022 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:24.810068 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.451s I1031 23:15:24.810137 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:15:24.810685 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:15:24.810711 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:15:24.810982 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:15:24.811022 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:15:24.811035 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:24.811172 34193 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.613s I1031 23:15:24.811200 34193 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:25.779345 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:25.779400 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.987s I1031 23:15:25.779464 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:15:25.780050 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:15:25.780081 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:15:25.780328 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:15:25.780377 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:15:25.780406 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:25.781031 34198 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.089s I1031 23:15:25.781060 34198 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:30.057569 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:30.057615 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.684s I1031 23:15:30.057672 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:15:30.058248 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:15:30.058274 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:15:30.058503 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:15:30.058560 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:15:30.058573 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:30.058815 34405 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.399s I1031 23:15:30.058835 34405 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:30.223618 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:30.223644 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.713s I1031 23:15:30.223683 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:15:30.224161 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:15:30.224196 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:15:30.224406 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:15:30.224442 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:15:30.224462 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:30.224745 34408 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.421s I1031 23:15:30.224766 34408 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:32.765178 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:32.765223 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.588s I1031 23:15:32.765278 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:15:32.765848 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:15:32.765877 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:15:32.766127 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:15:32.766155 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:15:32.766170 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:32.766405 34416 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.944s I1031 23:15:32.766443 34416 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:36.897750 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:36.897802 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.886s I1031 23:15:36.897864 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:15:36.898413 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:15:36.898437 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:15:36.898653 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:15:36.898689 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:15:36.898710 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:36.899041 34439 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.125s I1031 23:15:36.899067 34439 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:38.546198 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:38.546260 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.358s I1031 23:15:38.546316 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:15:38.547008 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:15:38.547042 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:15:38.547260 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:15:38.547310 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:15:38.547330 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:38.547574 34459 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.752s I1031 23:15:38.547595 34459 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:39.003732 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:39.003770 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.515s I1031 23:15:39.003808 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:15:39.004220 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:15:39.004257 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:15:39.004511 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:15:39.004545 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:15:39.004556 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:39.004751 34460 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.543s I1031 23:15:39.004775 34460 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:45.691550 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:45.691591 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.219s I1031 23:15:45.691648 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:15:45.692158 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:15:45.692189 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:15:45.692345 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:15:45.692409 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:15:45.692432 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:45.692679 34484 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.010s I1031 23:15:45.692708 34484 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:48.630203 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:48.630256 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.027s I1031 23:15:48.630309 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:15:48.630872 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:15:48.630897 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:15:48.631134 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:15:48.631199 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:15:48.631214 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:48.631474 34506 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.825s I1031 23:15:48.631501 34506 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:50.526362 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:50.526407 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.818s I1031 23:15:50.526450 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:15:50.526901 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:15:50.526945 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:15:50.527246 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:15:50.527292 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:15:50.527314 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:50.527492 34511 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.555s I1031 23:15:50.527511 34511 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:52.135041 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:52.135078 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.467s I1031 23:15:52.135128 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:15:52.135684 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:15:52.135720 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:15:52.135924 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:15:52.135974 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:15:52.135993 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:52.136118 34517 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.155s I1031 23:15:52.136138 34517 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:56.312980 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:56.313040 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.680s I1031 23:15:56.313093 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:15:56.313618 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:15:56.313642 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:15:56.313854 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:15:56.313904 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:15:56.313916 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:56.314220 34540 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.391s I1031 23:15:56.314240 34540 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:15:58.601083 32815 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:15:59.802852 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:15:59.802906 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.115s I1031 23:15:59.802958 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:15:59.803470 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:15:59.803495 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:15:59.803773 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:15:59.803812 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:15:59.803822 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:15:59.804114 34564 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.628s I1031 23:15:59.804139 34564 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:05.260160 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:05.260200 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.754s I1031 23:16:05.260258 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:16:05.260795 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:16:05.260833 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:16:05.261047 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:16:05.261101 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:16:05.261123 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:05.261257 34588 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.097s I1031 23:16:05.261286 34588 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:07.378820 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:07.378873 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.751s I1031 23:16:07.378926 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:16:07.379483 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:16:07.379519 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:16:07.379760 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:16:07.379796 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:16:07.379811 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:07.380146 34599 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.071s I1031 23:16:07.380172 34599 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:10.404482 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:10.404546 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.545s I1031 23:16:10.404595 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:16:10.405238 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:16:10.405278 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:16:10.405516 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:16:10.405562 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:16:10.405573 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:10.405879 34623 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.830s I1031 23:16:10.405899 34623 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:10.731323 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:10.731361 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.009s I1031 23:16:10.731402 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:16:10.731920 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:16:10.731946 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:16:10.732152 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:16:10.732249 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:16:10.732270 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:10.732667 34624 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.949s I1031 23:16:10.732687 34624 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:13.105949 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:13.106005 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.510s I1031 23:16:13.106053 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:16:13.106580 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:16:13.106616 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:16:13.106865 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:16:13.106900 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:16:13.106923 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:13.107234 34638 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.710s I1031 23:16:13.107257 34638 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:16.254889 27541 raft_consensus.cc:411] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:16.254940 27541 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.445s I1031 23:16:16.254997 27541 raft_consensus.cc:435] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "625f49b9554549e6a5c3a92b76e576cf" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st10.bj" port: 18700 } } I1031 23:16:16.255507 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:16:16.255548 27541 leader_election.cc:216] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 625f49b9554549e6a5c3a92b76e576cf W1031 23:16:16.255823 32773 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:16:16.255879 32771 leader_election.cc:278] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 625f49b9554549e6a5c3a92b76e576cf: Not found: Tablet not found I1031 23:16:16.255900 32771 leader_election.cc:243] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:16.256188 34657 raft_consensus.cc:2162] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.973s I1031 23:16:16.256208 34657 raft_consensus.cc:1908] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:19.105567 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:19.105628 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.263s I1031 23:16:19.105692 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:16:19.106221 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:16:19.106245 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:16:19.106474 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:16:19.106503 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:16:19.106515 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:19.106706 34678 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.255s I1031 23:16:19.106746 34678 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:19.636525 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:19.636574 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.273s I1031 23:16:19.636641 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:16:19.637220 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:16:19.637248 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:16:19.637428 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:16:19.637473 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:16:19.637491 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:19.638003 34683 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.754s I1031 23:16:19.638026 34683 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:21.456699 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:21.456749 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.053s I1031 23:16:21.456805 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:16:21.457327 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:16:21.457358 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:16:21.457597 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:16:21.457624 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:16:21.457648 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:21.457815 34690 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.615s I1031 23:16:21.457841 34690 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:26.699192 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:26.699232 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.919s I1031 23:16:26.699281 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:16:26.699750 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:16:26.699775 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:16:26.699944 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:16:26.699967 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:16:26.699987 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:26.700315 34707 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.332s I1031 23:16:26.700343 34707 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:27.187247 32803 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op CompactRowSetsOp(69b4b5f037014f10bfab077f3f98ca49) I1031 23:16:27.187305 32803 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MinorDeltaCompactionOp(69b4b5f037014f10bfab077f3f98ca49) I1031 23:16:27.187319 32803 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op MajorDeltaCompactionOp(69b4b5f037014f10bfab077f3f98ca49) I1031 23:16:27.187327 32803 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op UndoDeltaBlockGCOp(69b4b5f037014f10bfab077f3f98ca49) I1031 23:16:27.187342 32803 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushMRSOp(69b4b5f037014f10bfab077f3f98ca49) I1031 23:16:27.187366 32803 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op FlushDeltaMemStoresOp(69b4b5f037014f10bfab077f3f98ca49) I1031 23:16:27.187376 32803 maintenance_manager.cc:208] P 23f962e4a1744381ad5fa0d2d8b10241: Unregistered op LogGCOp(69b4b5f037014f10bfab077f3f98ca49) I1031 23:16:27.187386 32803 raft_consensus.cc:1569] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus shutting down. I1031 23:16:27.187398 32803 raft_consensus.cc:1585] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Raft consensus is shut down! I1031 23:16:27.189390 32803 ts_tablet_manager.cc:1020] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241: Deleting tablet data with delete state TABLET_DATA_DELETED I1031 23:16:27.419175 32760 maintenance_manager.cc:419] Time spent running UndoDeltaBlockGCOp(3123639d9835456b9f5dab3f7dd7ebd9): real 0.232s user 0.003s sys 0.000s I1031 23:16:27.419232 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: UndoDeltaBlockGCOp(3123639d9835456b9f5dab3f7dd7ebd9) metrics: {"data dir 6.queue_time_us":153,"data dir 6.run_cpu_time_us":54,"data dir 6.run_wall_time_us":53,"fdatasync":1,"fdatasync_us":212101,"thread_start_us":144,"threads_started":1} I1031 23:16:27.502495 32803 ts_tablet_manager.cc:1032] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241: Tablet deleted. Last logged OpId: 0.0 I1031 23:16:27.502549 32803 log.cc:876] T 69b4b5f037014f10bfab077f3f98ca49 P 23f962e4a1744381ad5fa0d2d8b10241: Deleting WAL directory at /home/work/app/kudu/c3prc-kernel65/kudu_tablet_server/hdd1/wals/69b4b5f037014f10bfab077f3f98ca49 I1031 23:16:27.502704 32803 consensus_meta.cc:71] T 69b4b5f037014f10bfab077f3f98ca49 Deleting consensus metadata W1031 23:16:27.527909 32803 rpcz_store.cc:234] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 10.108.187.10:62607 (request call id 307) took 419066ms (client timeout 29999). W1031 23:16:27.527978 32803 rpcz_store.cc:238] Trace: 1031 23:09:28.461643 (+ 0us) service_pool.cc:143] Inserting onto call queue 1031 23:09:28.461690 (+ 47us) service_pool.cc:202] Handling call 1031 23:09:28.461720 (+ 30us) ts_tablet_manager.cc:572] Deleting tablet 69b4b5f037014f10bfab077f3f98ca49 1031 23:09:28.461720 (+ 0us) ts_tablet_manager.cc:580] Acquired tablet manager lock 1031 23:16:27.435291 (+418973571us) tablet_metadata.cc:461] Metadata flushed 1031 23:16:27.502476 (+ 67185us) tablet_metadata.cc:461] Metadata flushed 1031 23:16:27.527894 (+ 25418us) inbound_call.cc:130] Queueing success response Metrics: {"fdatasync":2,"fdatasync_us":244884,"mutex_wait_us":418725475} I1031 23:16:27.528324 32760 maintenance_manager.cc:419] Time spent running UndoDeltaBlockGCOp(2765976a053c4287874c0cb2fb7781b2): real 0.071s user 0.001s sys 0.001s I1031 23:16:27.528372 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: UndoDeltaBlockGCOp(2765976a053c4287874c0cb2fb7781b2) metrics: {"data dir 7.queue_time_us":337,"data dir 7.run_cpu_time_us":51,"data dir 7.run_wall_time_us":51,"fdatasync":1,"fdatasync_us":41488,"thread_start_us":325,"threads_started":1} I1031 23:16:27.729094 32760 tablet.cc:911] T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering stage 1 (old memrowset already frozen for inserts) I1031 23:16:27.729110 32760 compaction.cc:877] Selected 1 rowsets to compact: I1031 23:16:27.729116 32760 compaction.cc:880] memrowset(current size on disk: ~0 bytes) I1031 23:16:27.729122 32760 tablet.cc:913] T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Memstore in-memory size: 1019671 bytes I1031 23:16:27.729133 32760 tablet.cc:1174] T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6182760396819963904 or (T in {6182760396819963904})}] I1031 23:16:27.729346 32760 multi_column_writer.cc:85] Opened CFile writer for column olap_date[int32 NOT NULL] I1031 23:16:27.729388 32760 multi_column_writer.cc:85] Opened CFile writer for column timestamp[int64 NOT NULL] I1031 23:16:27.729420 32760 multi_column_writer.cc:85] Opened CFile writer for column tweet_id[int64 NOT NULL] I1031 23:16:27.729465 32760 multi_column_writer.cc:85] Opened CFile writer for column created_at[string NULLABLE] I1031 23:16:27.729513 32760 multi_column_writer.cc:85] Opened CFile writer for column text[string NULLABLE] I1031 23:16:27.729554 32760 multi_column_writer.cc:85] Opened CFile writer for column source[string NULLABLE] I1031 23:16:27.729588 32760 multi_column_writer.cc:85] Opened CFile writer for column user_id[int64 NULLABLE] I1031 23:16:27.729624 32760 multi_column_writer.cc:85] Opened CFile writer for column user_name[string NULLABLE] I1031 23:16:27.729663 32760 multi_column_writer.cc:85] Opened CFile writer for column user_location[string NULLABLE] I1031 23:16:27.729694 32760 multi_column_writer.cc:85] Opened CFile writer for column user_followers_count[int32 NULLABLE] I1031 23:16:27.729732 32760 multi_column_writer.cc:85] Opened CFile writer for column user_friends_count[int32 NULLABLE] I1031 23:16:28.116595 32760 tablet.cc:1259] T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I1031 23:16:28.117681 32760 tablet.cc:1314] T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Flush Phase 2: carrying over any updates which arrived during Phase 1 I1031 23:16:28.117697 32760 tablet.cc:1316] T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6182760398994915328 or (T in {6182760398994915328})}] I1031 23:16:28.162955 32760 tablet.cc:1358] T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Flush successful on 2052 rows (312655 bytes) I1031 23:16:28.163271 32760 maintenance_manager.cc:419] Time spent running FlushMRSOp(03802df37c9543298202506697cc8906): real 0.435s user 0.017s sys 0.000s I1031 23:16:28.163306 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: FlushMRSOp(03802df37c9543298202506697cc8906) metrics: {"cfile_init":1,"data dir 5.queue_time_us":261,"data dir 5.run_cpu_time_us":148,"data dir 5.run_wall_time_us":225311,"fdatasync":29,"fdatasync_us":400651,"lbm_read_time_us":7,"lbm_reads_lt_1ms":4,"lbm_write_time_us":714,"lbm_writes_lt_1ms":87,"thread_start_us":250,"threads_started":1} I1031 23:16:28.259881 32760 tablet.cc:911] T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering stage 1 (old memrowset already frozen for inserts) I1031 23:16:28.259907 32760 compaction.cc:877] Selected 1 rowsets to compact: I1031 23:16:28.259917 32760 compaction.cc:880] memrowset(current size on disk: ~0 bytes) I1031 23:16:28.259927 32760 tablet.cc:913] T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Memstore in-memory size: 1019671 bytes I1031 23:16:28.259934 32760 tablet.cc:1174] T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6182760399907708928}] I1031 23:16:28.260046 32760 multi_column_writer.cc:85] Opened CFile writer for column olap_date[int32 NOT NULL] I1031 23:16:28.260088 32760 multi_column_writer.cc:85] Opened CFile writer for column timestamp[int64 NOT NULL] I1031 23:16:28.260124 32760 multi_column_writer.cc:85] Opened CFile writer for column tweet_id[int64 NOT NULL] I1031 23:16:28.260165 32760 multi_column_writer.cc:85] Opened CFile writer for column created_at[string NULLABLE] I1031 23:16:28.260200 32760 multi_column_writer.cc:85] Opened CFile writer for column text[string NULLABLE] I1031 23:16:28.260233 32760 multi_column_writer.cc:85] Opened CFile writer for column source[string NULLABLE] I1031 23:16:28.260264 32760 multi_column_writer.cc:85] Opened CFile writer for column user_id[int64 NULLABLE] I1031 23:16:28.260308 32760 multi_column_writer.cc:85] Opened CFile writer for column user_name[string NULLABLE] I1031 23:16:28.260339 32760 multi_column_writer.cc:85] Opened CFile writer for column user_location[string NULLABLE] I1031 23:16:28.260372 32760 multi_column_writer.cc:85] Opened CFile writer for column user_followers_count[int32 NULLABLE] I1031 23:16:28.260399 32760 multi_column_writer.cc:85] Opened CFile writer for column user_friends_count[int32 NULLABLE] I1031 23:16:28.452641 32760 tablet.cc:1259] T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I1031 23:16:28.453416 32760 tablet.cc:1314] T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush Phase 2: carrying over any updates which arrived during Phase 1 I1031 23:16:28.453434 32760 tablet.cc:1316] T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6182760399907708928 or (T in {6182760399907708928})}] I1031 23:16:28.496913 32760 tablet.cc:1358] T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush successful on 2014 rows (309745 bytes) I1031 23:16:28.497169 32760 maintenance_manager.cc:419] Time spent running FlushMRSOp(2765976a053c4287874c0cb2fb7781b2): real 0.238s user 0.014s sys 0.001s I1031 23:16:28.497200 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: FlushMRSOp(2765976a053c4287874c0cb2fb7781b2) metrics: {"cfile_init":1,"data dir 4.queue_time_us":106,"data dir 4.run_cpu_time_us":160,"data dir 4.run_wall_time_us":20146,"fdatasync":29,"fdatasync_us":206088,"lbm_read_time_us":4,"lbm_reads_lt_1ms":4,"lbm_write_time_us":656,"lbm_writes_lt_1ms":87,"thread_start_us":94,"threads_started":1} I1031 23:16:28.532277 32760 tablet.cc:911] T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering stage 1 (old memrowset already frozen for inserts) I1031 23:16:28.532295 32760 compaction.cc:877] Selected 1 rowsets to compact: I1031 23:16:28.532300 32760 compaction.cc:880] memrowset(current size on disk: ~0 bytes) I1031 23:16:28.532305 32760 tablet.cc:913] T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Memstore in-memory size: 1019671 bytes I1031 23:16:28.532312 32760 tablet.cc:1174] T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6182760400705695744 or (T in {6182760400705695744})}] I1031 23:16:28.532387 32760 multi_column_writer.cc:85] Opened CFile writer for column olap_date[int32 NOT NULL] I1031 23:16:28.532416 32760 multi_column_writer.cc:85] Opened CFile writer for column timestamp[int64 NOT NULL] I1031 23:16:28.532444 32760 multi_column_writer.cc:85] Opened CFile writer for column tweet_id[int64 NOT NULL] I1031 23:16:28.532498 32760 multi_column_writer.cc:85] Opened CFile writer for column created_at[string NULLABLE] I1031 23:16:28.532528 32760 multi_column_writer.cc:85] Opened CFile writer for column text[string NULLABLE] I1031 23:16:28.532555 32760 multi_column_writer.cc:85] Opened CFile writer for column source[string NULLABLE] I1031 23:16:28.532582 32760 multi_column_writer.cc:85] Opened CFile writer for column user_id[int64 NULLABLE] I1031 23:16:28.532609 32760 multi_column_writer.cc:85] Opened CFile writer for column user_name[string NULLABLE] I1031 23:16:28.532634 32760 multi_column_writer.cc:85] Opened CFile writer for column user_location[string NULLABLE] I1031 23:16:28.532658 32760 multi_column_writer.cc:85] Opened CFile writer for column user_followers_count[int32 NULLABLE] I1031 23:16:28.532680 32760 multi_column_writer.cc:85] Opened CFile writer for column user_friends_count[int32 NULLABLE] I1031 23:16:28.753204 32760 tablet.cc:1259] T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I1031 23:16:28.753975 32760 tablet.cc:1314] T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Flush Phase 2: carrying over any updates which arrived during Phase 1 I1031 23:16:28.754003 32760 tablet.cc:1316] T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6182760401538314240 or (T in {6182760401538314240})}] I1031 23:16:28.798220 32760 tablet.cc:1358] T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Flush successful on 2000 rows (306306 bytes) I1031 23:16:28.798511 32760 maintenance_manager.cc:419] Time spent running FlushMRSOp(3123639d9835456b9f5dab3f7dd7ebd9): real 0.267s user 0.014s sys 0.000s I1031 23:16:28.798540 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: FlushMRSOp(3123639d9835456b9f5dab3f7dd7ebd9) metrics: {"cfile_init":1,"data dir 3.queue_time_us":265,"data dir 3.run_cpu_time_us":120,"data dir 3.run_wall_time_us":15977,"fdatasync":29,"fdatasync_us":235102,"lbm_read_time_us":4,"lbm_reads_lt_1ms":4,"lbm_write_time_us":566,"lbm_writes_lt_1ms":87,"thread_start_us":253,"threads_started":1} I1031 23:16:29.098249 32760 maintenance_manager.cc:419] Time spent running UndoDeltaBlockGCOp(03802df37c9543298202506697cc8906): real 0.043s user 0.002s sys 0.000s I1031 23:16:29.098354 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: UndoDeltaBlockGCOp(03802df37c9543298202506697cc8906) metrics: {"cfile_init":1,"data dir 0.queue_time_us":216,"data dir 0.run_cpu_time_us":63,"data dir 0.run_wall_time_us":64,"fdatasync":1,"fdatasync_us":24469,"lbm_read_time_us":7,"lbm_reads_lt_1ms":4,"thread_start_us":201,"threads_started":1} I1031 23:16:29.325580 32760 maintenance_manager.cc:419] Time spent running UndoDeltaBlockGCOp(3123639d9835456b9f5dab3f7dd7ebd9): real 0.000s user 0.000s sys 0.000s I1031 23:16:29.325603 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: UndoDeltaBlockGCOp(3123639d9835456b9f5dab3f7dd7ebd9) metrics: {"cfile_init":1,"lbm_read_time_us":8,"lbm_reads_lt_1ms":4} I1031 23:16:29.596227 32760 maintenance_manager.cc:419] Time spent running UndoDeltaBlockGCOp(2765976a053c4287874c0cb2fb7781b2): real 0.000s user 0.000s sys 0.000s I1031 23:16:29.596251 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: UndoDeltaBlockGCOp(2765976a053c4287874c0cb2fb7781b2) metrics: {"cfile_init":1,"lbm_read_time_us":8,"lbm_reads_lt_1ms":4} I1031 23:16:29.867702 32760 tablet.cc:911] T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering stage 1 (old memrowset already frozen for inserts) I1031 23:16:29.867719 32760 compaction.cc:877] Selected 1 rowsets to compact: I1031 23:16:29.867725 32760 compaction.cc:880] memrowset(current size on disk: ~0 bytes) I1031 23:16:29.867739 32760 tablet.cc:913] T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Memstore in-memory size: 1019671 bytes I1031 23:16:29.867748 32760 tablet.cc:1174] T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6182760404373401600 or (T in {6182760404373401600})}] I1031 23:16:29.867846 32760 multi_column_writer.cc:85] Opened CFile writer for column olap_date[int32 NOT NULL] I1031 23:16:29.867882 32760 multi_column_writer.cc:85] Opened CFile writer for column timestamp[int64 NOT NULL] I1031 23:16:29.867914 32760 multi_column_writer.cc:85] Opened CFile writer for column tweet_id[int64 NOT NULL] I1031 23:16:29.867954 32760 multi_column_writer.cc:85] Opened CFile writer for column created_at[string NULLABLE] I1031 23:16:29.868002 32760 multi_column_writer.cc:85] Opened CFile writer for column text[string NULLABLE] I1031 23:16:29.868034 32760 multi_column_writer.cc:85] Opened CFile writer for column source[string NULLABLE] I1031 23:16:29.868080 32760 multi_column_writer.cc:85] Opened CFile writer for column user_id[int64 NULLABLE] I1031 23:16:29.868129 32760 multi_column_writer.cc:85] Opened CFile writer for column user_name[string NULLABLE] I1031 23:16:29.868158 32760 multi_column_writer.cc:85] Opened CFile writer for column user_location[string NULLABLE] I1031 23:16:29.868193 32760 multi_column_writer.cc:85] Opened CFile writer for column user_followers_count[int32 NULLABLE] I1031 23:16:29.868225 32760 multi_column_writer.cc:85] Opened CFile writer for column user_friends_count[int32 NULLABLE] I1031 23:16:30.079794 32760 tablet.cc:1259] T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I1031 23:16:30.080593 32760 tablet.cc:1314] T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush Phase 2: carrying over any updates which arrived during Phase 1 I1031 23:16:30.080608 32760 tablet.cc:1316] T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6182760407246233600 or (T in {6182760407246233600})}] I1031 23:16:30.124294 32760 tablet.cc:1358] T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Flush successful on 1967 rows (300841 bytes) I1031 23:16:30.124521 32760 maintenance_manager.cc:419] Time spent running FlushMRSOp(3a949c88a8864d509b058fddddebc6d2): real 0.258s user 0.013s sys 0.003s I1031 23:16:30.124550 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: FlushMRSOp(3a949c88a8864d509b058fddddebc6d2) metrics: {"cfile_init":1,"data dir 2.queue_time_us":217,"data dir 2.run_cpu_time_us":154,"data dir 2.run_wall_time_us":19190,"fdatasync":29,"fdatasync_us":225078,"lbm_read_time_us":4,"lbm_reads_lt_1ms":4,"lbm_write_time_us":707,"lbm_writes_lt_1ms":87,"thread_start_us":205,"threads_started":1} I1031 23:16:30.441289 32760 maintenance_manager.cc:419] Time spent running UndoDeltaBlockGCOp(3a949c88a8864d509b058fddddebc6d2): real 0.044s user 0.001s sys 0.000s I1031 23:16:30.441392 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: UndoDeltaBlockGCOp(3a949c88a8864d509b058fddddebc6d2) metrics: {"cfile_init":1,"data dir 5.queue_time_us":266,"data dir 5.run_cpu_time_us":55,"data dir 5.run_wall_time_us":55,"fdatasync":1,"fdatasync_us":24931,"lbm_read_time_us":7,"lbm_reads_lt_1ms":4,"thread_start_us":257,"threads_started":1} I1031 23:16:30.836524 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:30.836578 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.499s I1031 23:16:30.836632 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:16:30.837168 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:16:30.837208 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:16:30.837460 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:16:30.837491 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:16:30.837507 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:30.838137 34924 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.070s I1031 23:16:30.838173 34924 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:31.072568 32760 maintenance_manager.cc:419] Time spent running UndoDeltaBlockGCOp(3409046e569643c3a083c3f27cfe1582): real 0.405s user 0.312s sys 0.005s I1031 23:16:31.072903 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: UndoDeltaBlockGCOp(3409046e569643c3a083c3f27cfe1582) metrics: {"cfile_init":1,"data dir 2.queue_time_us":137,"data dir 2.run_cpu_time_us":40,"data dir 2.run_wall_time_us":40,"data dir 4.queue_time_us":267,"data dir 4.run_cpu_time_us":49,"data dir 4.run_wall_time_us":49,"fdatasync":1,"fdatasync_us":73076,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"tcmalloc_contention_cycles":80384,"thread_start_us":381,"threads_started":2} I1031 23:16:31.794309 32760 tablet.cc:911] T 3409046e569643c3a083c3f27cfe1582 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering stage 1 (old memrowset already frozen for inserts) I1031 23:16:31.794430 32760 compaction.cc:877] Selected 1 rowsets to compact: I1031 23:16:31.794447 32760 compaction.cc:880] memrowset(current size on disk: ~0 bytes) I1031 23:16:31.794463 32760 tablet.cc:913] T 3409046e569643c3a083c3f27cfe1582 P 23f962e4a1744381ad5fa0d2d8b10241: Memstore in-memory size: 1759 bytes I1031 23:16:31.794484 32760 tablet.cc:1174] T 3409046e569643c3a083c3f27cfe1582 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6182760330540052480 or (T in {6182760330540052480})}] I1031 23:16:31.794618 32760 multi_column_writer.cc:85] Opened CFile writer for column ts[int32 NOT NULL] I1031 23:16:31.794652 32760 multi_column_writer.cc:85] Opened CFile writer for column id[int32 NOT NULL] I1031 23:16:32.110666 32760 tablet.cc:1259] T 3409046e569643c3a083c3f27cfe1582 P 23f962e4a1744381ad5fa0d2d8b10241: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I1031 23:16:32.721129 32760 tablet.cc:1314] T 3409046e569643c3a083c3f27cfe1582 P 23f962e4a1744381ad5fa0d2d8b10241: Flush Phase 2: carrying over any updates which arrived during Phase 1 I1031 23:16:32.721261 32760 tablet.cc:1316] T 3409046e569643c3a083c3f27cfe1582 P 23f962e4a1744381ad5fa0d2d8b10241: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6182760330540052480 or (T in {6182760330540052480})}] I1031 23:16:33.652246 32760 tablet.cc:1358] T 3409046e569643c3a083c3f27cfe1582 P 23f962e4a1744381ad5fa0d2d8b10241: Flush successful on 13 rows (4354 bytes) I1031 23:16:33.652420 32760 maintenance_manager.cc:419] Time spent running FlushMRSOp(3409046e569643c3a083c3f27cfe1582): real 2.464s user 2.061s sys 0.006s I1031 23:16:33.652623 32760 maintenance_manager.cc:425] P 23f962e4a1744381ad5fa0d2d8b10241: FlushMRSOp(3409046e569643c3a083c3f27cfe1582) metrics: {"cfile_init":1,"fdatasync":11,"fdatasync_us":384903,"lbm_read_time_us":7,"lbm_reads_lt_1ms":4,"lbm_write_time_us":155,"lbm_writes_lt_1ms":26,"tcmalloc_contention_cycles":137600} I1031 23:16:38.265929 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:38.265986 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.601s I1031 23:16:38.266048 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:16:38.266604 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:16:38.266641 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:16:38.266871 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:16:38.266929 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:16:38.266942 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:38.267097 34977 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.504s I1031 23:16:38.267119 34977 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:38.455875 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:38.455899 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.269s I1031 23:16:38.455935 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:16:38.456370 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:16:38.456405 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:16:38.456598 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:16:38.456645 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:16:38.456661 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:38.456840 34978 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.634s I1031 23:16:38.456874 34978 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:39.105583 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:39.105634 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.155s I1031 23:16:39.105698 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:16:39.106228 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:16:39.106266 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:16:39.106528 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:16:39.106564 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:16:39.106577 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:39.106766 34980 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.580s I1031 23:16:39.106788 34980 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:49.580106 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:49.580157 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.870s I1031 23:16:49.580216 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:16:49.580726 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:16:49.580750 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:16:49.580972 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:16:49.581029 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:16:49.581049 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:49.581269 35023 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.387s I1031 23:16:49.581290 35023 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:51.609284 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:51.609339 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.669s I1031 23:16:51.609392 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:16:51.609902 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:16:51.609925 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:16:51.610165 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:16:51.610201 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:16:51.610216 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:51.610396 35032 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.184s I1031 23:16:51.610424 35032 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:54.919981 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:54.920043 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.295s I1031 23:16:54.920104 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:16:54.920644 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:16:54.920676 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:16:54.920925 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:16:54.920969 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:16:54.920984 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:54.921273 35044 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.964s I1031 23:16:54.921319 35044 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:55.629505 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:55.629545 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.988s I1031 23:16:55.629583 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:16:55.630107 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:16:55.630144 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:16:55.630334 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:16:55.630374 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:16:55.630390 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:55.630605 35047 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.538s I1031 23:16:55.630627 35047 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:56.798744 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:56.798787 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.133s I1031 23:16:56.798830 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:16:56.799363 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:16:56.799392 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:16:56.799620 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:16:56.799659 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:16:56.799677 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:56.799918 35055 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.217s I1031 23:16:56.799942 35055 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:57.566920 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:16:57.566970 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.854s I1031 23:16:57.567039 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:16:57.567584 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:16:57.567613 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:16:57.567895 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:16:57.567935 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:16:57.567947 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:16:57.568294 35057 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.524s I1031 23:16:57.568318 35057 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:16:58.616158 32803 tablet_service.cc:691] Processing DeleteTablet for tablet 69b4b5f037014f10bfab077f3f98ca49 with delete_type TABLET_DATA_DELETED (Replaced by b758ec3274c84dcbb110cf5aa3dca9aa at 2017-10-31 23:04:22 CST) from {username='work'} at 10.108.187.10:62607 I1031 23:17:00.992142 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:00.992197 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.188s I1031 23:17:00.992255 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:17:00.992913 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:17:00.992941 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:17:00.993227 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:17:00.993255 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:17:00.993278 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:00.993643 35085 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.675s I1031 23:17:00.993670 35085 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:02.594375 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:02.594425 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.406s I1031 23:17:02.594485 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:17:02.594965 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:17:02.595000 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:17:02.595232 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:17:02.595291 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:17:02.595304 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:02.595489 35188 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.693s I1031 23:17:02.595508 35188 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:17:02.643573 30396 log.cc:565] Time spent T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.054s user 0.000s sys 0.000s I1031 23:17:05.744627 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:05.744668 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.483s I1031 23:17:05.744720 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:17:05.745297 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:17:05.745332 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:17:05.745551 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:17:05.745602 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:17:05.745623 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:05.745921 35215 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.949s I1031 23:17:05.745942 35215 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:10.442940 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:10.442996 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.465s I1031 23:17:10.443053 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:17:10.443598 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:17:10.443639 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:17:10.443861 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:17:10.443897 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:17:10.443910 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:10.444258 35245 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.150s I1031 23:17:10.444284 35245 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:14.206933 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:14.206974 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.680s I1031 23:17:14.207033 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:17:14.207645 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:17:14.207669 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:17:14.207875 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:17:14.207911 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:17:14.207922 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:14.208112 35259 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.283s I1031 23:17:14.208151 35259 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:21.235787 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:21.235846 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.671s I1031 23:17:21.235895 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:17:21.236407 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:17:21.236429 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:17:21.236588 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:17:21.236620 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:17:21.236629 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:21.236874 35302 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.967s I1031 23:17:21.236901 35302 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:21.961213 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:21.961254 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.210s I1031 23:17:21.961298 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:17:21.961758 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:17:21.961792 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:17:21.962000 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:17:21.962074 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:17:21.962092 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:21.962563 35303 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.155s I1031 23:17:21.962584 35303 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:25.420281 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:25.420321 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.046s I1031 23:17:25.420369 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:17:25.420855 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:17:25.420879 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:17:25.421146 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:17:25.421187 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:17:25.421201 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:25.421459 35323 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.988s I1031 23:17:25.421479 35323 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:28.752684 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:28.752740 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.304s I1031 23:17:28.752792 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:17:28.753422 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:17:28.753445 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:17:28.753685 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:17:28.753720 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:17:28.753738 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:28.753964 35523 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.114s I1031 23:17:28.753993 35523 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:29.271742 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:29.271787 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.567s I1031 23:17:29.271839 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:17:29.272411 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:17:29.272439 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:17:29.272660 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:17:29.272696 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:17:29.272722 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:29.273106 35528 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.329s I1031 23:17:29.273129 35528 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:35.770814 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:35.770871 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.552s I1031 23:17:35.770922 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:17:35.771517 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:17:35.771543 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:17:35.771744 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:17:35.771775 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:17:35.771800 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:35.772027 35558 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.321s I1031 23:17:35.772054 35558 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:41.970162 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:41.970211 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.940s I1031 23:17:41.970266 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:17:41.970805 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:17:41.970836 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:17:41.971148 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:17:41.971277 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:17:41.971295 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:41.971631 35596 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.720s I1031 23:17:41.971653 35596 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:42.119004 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:42.119062 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.628s I1031 23:17:42.119115 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:17:42.119645 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:17:42.119668 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:17:42.119841 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:17:42.119930 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:17:42.119951 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:42.120303 35597 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.620s I1031 23:17:42.120324 35597 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:42.470252 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:42.470302 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.066s I1031 23:17:42.470343 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:17:42.470753 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:17:42.470789 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:17:42.471019 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:17:42.471045 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:17:42.471061 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:42.471570 35599 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.611s I1031 23:17:42.471590 35599 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:46.414968 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:46.415032 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.546s I1031 23:17:46.415083 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:17:46.415663 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:17:46.415697 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:17:46.415940 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:17:46.415982 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:17:46.416010 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:46.416211 35610 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.974s I1031 23:17:46.416237 35610 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:50.829107 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:50.829144 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.064s I1031 23:17:50.829193 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:17:50.829738 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:17:50.829773 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:17:50.830035 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:17:50.830063 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:17:50.830080 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:50.830273 35642 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.529s I1031 23:17:50.830302 35642 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:54.597599 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:54.597645 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.329s I1031 23:17:54.597697 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:17:54.598235 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:17:54.598260 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:17:54.598476 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:17:54.598515 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:17:54.598526 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:54.598866 35658 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.941s I1031 23:17:54.598894 35658 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:55.939313 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:55.939363 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.330s I1031 23:17:55.939415 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:17:55.940104 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:17:55.940140 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:17:55.940353 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:17:55.940419 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:17:55.940440 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:55.940626 35661 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.323s I1031 23:17:55.940663 35661 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:17:56.289850 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:17:56.289890 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.406s I1031 23:17:56.289929 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:17:56.290478 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:17:56.290513 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:17:56.290729 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:17:56.290766 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:17:56.290779 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:17:56.291314 35664 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.887s I1031 23:17:56.291334 35664 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:18:00.200101 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:18:00.200155 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.712s I1031 23:18:00.200206 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:18:00.200712 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:18:00.200740 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:18:00.200973 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:18:00.201038 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:18:00.201068 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:18:00.201192 35693 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.137s I1031 23:18:00.201215 35693 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:18:03.191651 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:18:03.191697 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.169s I1031 23:18:03.191761 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:18:03.192294 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:18:03.192322 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:18:03.192550 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:18:03.192591 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:18:03.192605 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:18:03.192862 35713 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.739s I1031 23:18:03.192896 35713 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:18:11.068642 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:18:11.068686 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.363s I1031 23:18:11.068744 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:18:11.069334 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:18:11.069360 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:18:11.069587 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:18:11.069612 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:18:11.069633 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:18:11.069766 35754 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.981s I1031 23:18:11.069793 35754 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:18:17.006590 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:18:17.006646 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.636s I1031 23:18:17.006707 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:18:17.007256 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:18:17.007283 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:18:17.007537 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:18:17.007612 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:18:17.007634 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:18:17.007997 35781 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.327s I1031 23:18:17.008044 35781 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:18:19.561062 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:18:19.561108 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.175s I1031 23:18:19.561166 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:18:19.561661 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:18:19.561689 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:18:19.561913 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:18:19.561961 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:18:19.561975 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:18:19.562150 35803 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.566s I1031 23:18:19.562171 35803 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:18:22.455395 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:18:22.455437 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.492s I1031 23:18:22.455492 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:18:22.455958 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:18:22.456002 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:18:22.456204 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:18:22.456290 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:18:22.456316 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:18:22.456495 35815 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.092s I1031 23:18:22.456516 35815 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:18:26.569988 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:18:26.570039 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.719s I1031 23:18:26.570097 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:18:26.570724 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:18:26.570751 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:18:26.570937 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:18:26.571045 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:18:26.571066 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:18:26.571454 35830 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.593s I1031 23:18:26.571483 35830 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:18:33.838106 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:18:33.838150 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.550s I1031 23:18:33.838212 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:18:33.838699 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:18:33.838739 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:18:33.838951 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:18:33.839004 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:18:33.839026 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:18:33.839172 36045 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.101s I1031 23:18:33.839200 36045 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:18:33.878798 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:18:33.878832 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.344s I1031 23:18:33.878880 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:18:33.879348 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:18:33.879374 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:18:33.879575 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:18:33.879611 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:18:33.879626 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:18:33.879907 36046 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.987s I1031 23:18:33.879928 36046 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:18:37.532464 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:18:37.532505 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.185s I1031 23:18:37.532559 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:18:37.533094 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:18:37.533123 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:18:37.533361 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:18:37.533401 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:18:37.533413 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:18:37.533620 36057 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.230s I1031 23:18:37.533648 36057 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:18:44.189092 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:18:44.189139 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.394s I1031 23:18:44.189204 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:18:44.189777 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:18:44.189803 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:18:44.190074 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:18:44.190114 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:18:44.190135 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:18:44.190495 36094 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.488s I1031 23:18:44.190544 36094 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:18:44.317205 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:18:44.317235 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.651s I1031 23:18:44.317291 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:18:44.317697 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:18:44.317731 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:18:44.317984 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:18:44.318058 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:18:44.318080 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:18:44.318357 36095 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.819s I1031 23:18:44.318378 36095 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:18:55.946843 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:18:55.946907 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.161s I1031 23:18:55.946965 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:18:55.947512 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:18:55.947540 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:18:55.947763 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:18:55.947860 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:18:55.947883 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:18:55.948068 36155 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.981s I1031 23:18:55.948091 36155 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:18:58.951591 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:18:58.951637 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.932s I1031 23:18:58.951694 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:18:58.952286 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:18:58.952314 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:18:58.952569 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:18:58.952615 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:18:58.952630 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:18:58.952824 36180 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.822s I1031 23:18:58.952862 36180 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:00.065479 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:00.065512 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.474s I1031 23:19:00.065560 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:19:00.066031 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:19:00.066061 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:19:00.066247 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:19:00.066454 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:19:00.066478 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:00.066606 36183 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.988s I1031 23:19:00.066629 36183 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:04.617136 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:04.617182 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.254s I1031 23:19:04.617255 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:19:04.617768 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:19:04.617796 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:19:04.618093 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:19:04.618149 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:19:04.618181 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:04.618523 36204 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.723s I1031 23:19:04.618553 36204 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:06.529608 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:06.529644 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.161s I1031 23:19:06.529700 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:19:06.530166 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:19:06.530194 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:19:06.530481 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:19:06.530520 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:19:06.530541 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:06.530663 36211 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.570s I1031 23:19:06.530683 36211 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:13.643975 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:13.644026 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.145s I1031 23:19:13.644084 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:19:13.644655 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:19:13.644693 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:19:13.644940 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:19:13.644974 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:19:13.644992 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:13.645268 36250 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.944s I1031 23:19:13.645297 36250 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:18.816588 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:18.816632 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.028s I1031 23:19:18.816699 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:19:18.817179 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:19:18.817212 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:19:18.817479 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:19:18.817517 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:19:18.817533 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:18.817900 36281 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.655s I1031 23:19:18.817929 36281 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:18.970109 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:18.970136 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.049s I1031 23:19:18.970186 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:19:18.970697 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:19:18.970723 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:19:18.970994 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:19:18.971036 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:19:18.971058 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:18.971174 36282 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.367s I1031 23:19:18.971194 36282 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:19:19.397755 30386 log.cc:565] Time spent T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.126s user 0.000s sys 0.000s W1031 23:19:19.397781 30381 log.cc:565] Time spent T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.189s user 0.000s sys 0.000s W1031 23:19:19.397780 30391 log.cc:565] Time spent T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.133s user 0.000s sys 0.000s I1031 23:19:23.236858 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:23.236902 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.582s I1031 23:19:23.236956 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:19:23.237484 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:19:23.237512 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:19:23.237716 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:19:23.237758 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:19:23.237771 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:23.238040 36306 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.878s I1031 23:19:23.238065 36306 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:28.381427 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:28.381475 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.536s I1031 23:19:28.381548 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:19:28.382179 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:19:28.382207 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:19:28.382417 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:19:28.382513 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:19:28.382535 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:28.382668 36523 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.289s I1031 23:19:28.382699 36523 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:29.030158 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:29.030202 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.287s I1031 23:19:29.030248 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:19:29.030691 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:19:29.030719 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:19:29.030956 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:19:29.030984 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:19:29.031010 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:29.031281 36524 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.701s I1031 23:19:29.031303 36524 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:29.361868 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:29.361896 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.147s I1031 23:19:29.361934 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:19:29.362356 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:19:29.362390 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:19:29.362612 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:19:29.362774 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:19:29.362797 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:29.363031 36525 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.923s I1031 23:19:29.363054 36525 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:33.747488 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:33.747539 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.699s I1031 23:19:33.747603 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:19:33.748193 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:19:33.748216 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:19:33.748436 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:19:33.748464 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:19:33.748489 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:33.748674 36534 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.959s I1031 23:19:33.748700 36534 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:43.152559 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:43.152613 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.043s I1031 23:19:43.152665 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:19:43.153193 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:19:43.153220 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:19:43.153466 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:19:43.153556 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:19:43.153599 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:43.153901 36587 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.863s I1031 23:19:43.153921 36587 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:46.791725 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:46.791767 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.031s I1031 23:19:46.791831 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:19:46.792480 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:19:46.792507 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:19:46.792764 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:19:46.792810 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:19:46.792824 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:46.792975 36603 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.291s I1031 23:19:46.793023 36603 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:47.622871 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:47.622902 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.550s I1031 23:19:47.622949 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:19:47.623421 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:19:47.623461 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:19:47.623720 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:19:47.623751 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:19:47.623769 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:47.624214 36607 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.107s I1031 23:19:47.624238 36607 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:50.292951 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:50.292999 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.102s I1031 23:19:50.293059 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:19:50.293647 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:19:50.293671 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:19:50.293867 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:19:50.293923 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:19:50.293936 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:50.294116 36632 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.476s I1031 23:19:50.294147 36632 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:51.238123 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:51.238163 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.264s I1031 23:19:51.238205 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:19:51.238658 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:19:51.238687 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:19:51.238926 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:19:51.238958 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:19:51.238970 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:51.239397 36636 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.720s I1031 23:19:51.239434 36636 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:19:52.555022 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:52.555069 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.942s I1031 23:19:52.555131 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:19:52.555651 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:19:52.555686 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:19:52.555938 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:19:52.555974 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:19:52.555994 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:52.556185 36642 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.801s I1031 23:19:52.556210 36642 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:19:54.632410 30391 log.cc:565] Time spent T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.175s user 0.000s sys 0.000s W1031 23:19:54.632401 30381 log.cc:565] Time spent T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.090s user 0.000s sys 0.000s W1031 23:19:54.632429 30396 log.cc:565] Time spent T 03802df37c9543298202506697cc8906 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.110s user 0.001s sys 0.000s W1031 23:19:54.632431 30386 log.cc:565] Time spent T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.150s user 0.000s sys 0.000s I1031 23:19:55.624322 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:19:55.624366 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.478s I1031 23:19:55.624423 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:19:55.624979 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:19:55.625032 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:19:55.625295 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:19:55.625336 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:19:55.625352 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:19:55.625628 36655 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.368s I1031 23:19:55.625653 36655 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:03.593118 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:03.593164 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.871s I1031 23:20:03.593221 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:20:03.593852 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:20:03.593878 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:20:03.594142 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:20:03.594205 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:20:03.594218 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:03.594555 36703 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.223s I1031 23:20:03.594576 36703 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:06.870414 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:06.870460 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.734s I1031 23:20:06.870517 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:20:06.871107 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:20:06.871134 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:20:06.871320 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:20:06.871357 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:20:06.871378 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:06.871752 36719 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.008s I1031 23:20:06.871779 36719 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:09.475527 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:09.475570 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.044s I1031 23:20:09.475628 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:20:09.476111 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:20:09.476140 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:20:09.476408 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:20:09.476450 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:20:09.476462 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:09.476714 36747 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.631s I1031 23:20:09.476757 36747 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:11.524986 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:11.525035 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.926s I1031 23:20:11.525095 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:20:11.525676 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:20:11.525715 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:20:11.525939 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:20:11.525982 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:20:11.526000 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:11.526355 36760 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.019s I1031 23:20:11.526381 36760 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:13.193183 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:13.193220 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.373s I1031 23:20:13.193270 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:20:13.193698 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:20:13.193724 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:20:13.193987 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:20:13.194037 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:20:13.194058 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:13.194278 36766 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.707s I1031 23:20:13.194315 36766 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:16.386488 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:16.386538 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.553s I1031 23:20:16.386593 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:20:16.387070 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:20:16.387099 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:20:16.387334 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:20:16.387375 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:20:16.387389 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:16.387516 36776 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.982s I1031 23:20:16.387542 36776 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:19.507761 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:19.507812 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.410s I1031 23:20:19.507863 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:20:19.508334 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:20:19.508360 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:20:19.508534 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:20:19.508661 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:20:19.508689 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:19.508816 36804 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.445s I1031 23:20:19.508837 36804 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:26.206033 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:26.206075 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.506s I1031 23:20:26.206127 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:20:26.206708 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:20:26.206737 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:20:26.206943 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:20:26.207088 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:20:26.207113 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:26.207315 36818 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.449s I1031 23:20:26.207341 36818 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:27.965577 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:27.965621 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.946s I1031 23:20:27.965679 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:20:27.966125 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:20:27.966152 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:20:27.966305 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:20:27.966471 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:20:27.966495 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:27.966744 36914 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.723s I1031 23:20:27.966763 36914 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:29.529026 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:29.529080 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.423s I1031 23:20:29.529131 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:20:29.529649 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:20:29.529672 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:20:29.529937 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:20:29.529997 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:20:29.530006 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:29.530127 37026 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.457s I1031 23:20:29.530148 37026 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:20:29.634361 30391 log.cc:565] Time spent T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.052s user 0.000s sys 0.000s I1031 23:20:33.871906 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:33.871959 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.217s I1031 23:20:33.872022 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:20:33.872545 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:20:33.872570 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:20:33.872763 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:20:33.872856 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:20:33.872881 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:33.873225 37041 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.121s I1031 23:20:33.873251 37041 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:38.445663 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:38.445719 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.678s I1031 23:20:38.445770 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:20:38.446388 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:20:38.446424 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:20:38.446631 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:20:38.446658 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:20:38.446676 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:38.447016 37073 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.733s I1031 23:20:38.447044 37073 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:39.790143 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:39.790196 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.585s I1031 23:20:39.790249 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:20:39.790778 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:20:39.790812 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:20:39.791049 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:20:39.791147 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:20:39.791169 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:39.791373 37079 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.914s I1031 23:20:39.791393 37079 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:39.793094 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:39.793130 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.196s I1031 23:20:39.793169 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:20:39.793597 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:20:39.793622 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:20:39.793851 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:20:39.793932 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:20:39.793954 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:39.794203 37080 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.467s I1031 23:20:39.794222 37080 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:43.691414 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:43.691458 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.529s I1031 23:20:43.691525 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:20:43.692091 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:20:43.692117 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:20:43.692411 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:20:43.692456 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:20:43.692472 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:43.692773 37094 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.517s I1031 23:20:43.692800 37094 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:45.877598 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:45.877642 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.941s I1031 23:20:45.877696 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:20:45.878250 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:20:45.878278 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:20:45.878469 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found W1031 23:20:45.878525 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:20:45.878535 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:45.878768 37100 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.879s I1031 23:20:45.878789 37100 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:46.357723 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:46.357751 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.039s I1031 23:20:46.357795 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:20:46.358274 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:20:46.358301 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:20:46.358628 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:20:46.358669 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:20:46.358695 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:46.359036 37101 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.186s I1031 23:20:46.359058 37101 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:46.612447 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:46.612504 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.634s I1031 23:20:46.612551 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:20:46.613055 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:20:46.613085 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:20:46.613358 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:20:46.613416 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:20:46.613437 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:46.613942 37102 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.600s I1031 23:20:46.613963 37102 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:50.483129 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:50.483170 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.831s I1031 23:20:50.483223 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:20:50.483722 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:20:50.483752 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:20:50.484036 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:20:50.484155 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:20:50.484190 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:50.484509 37129 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.184s I1031 23:20:50.484529 37129 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:54.301273 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:54.301318 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.708s I1031 23:20:54.301375 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:20:54.301883 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:20:54.301910 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:20:54.302135 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:20:54.302173 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:20:54.302196 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:54.302562 37141 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 14.833s I1031 23:20:54.302610 37141 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:20:55.525601 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:20:55.525642 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.255s I1031 23:20:55.525704 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:20:55.526201 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:20:55.526237 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:20:55.526492 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:20:55.526541 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:20:55.526557 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:20:55.526676 37147 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.283s I1031 23:20:55.526697 37147 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:05.080663 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:05.080708 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.041s I1031 23:21:05.080765 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:21:05.081089 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:05.081115 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.856s I1031 23:21:05.081164 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:21:05.081393 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:21:05.081432 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:21:05.081637 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:21:05.081753 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:21:05.081756 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:21:05.081779 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:05.081795 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:21:05.081997 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:21:05.082042 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:21:05.082031 37196 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.698s I1031 23:21:05.082059 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:05.082077 37196 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:05.082322 37197 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.872s I1031 23:21:05.082337 37197 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:09.470286 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:09.470332 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.589s I1031 23:21:09.470388 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:21:09.470940 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:21:09.470968 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:21:09.471175 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:21:09.471220 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:21:09.471233 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:09.471436 37224 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.158s I1031 23:21:09.471457 37224 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:10.750694 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:10.750727 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.435s I1031 23:21:10.750785 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:21:10.751281 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:21:10.751307 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:21:10.751480 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:21:10.751642 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:21:10.751664 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:10.751862 37229 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.626s I1031 23:21:10.751888 37229 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:13.560335 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:13.560386 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.250s I1031 23:21:13.560441 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:21:13.560950 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:21:13.560978 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:21:13.561177 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:21:13.561337 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:21:13.561365 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:13.561492 37235 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.715s I1031 23:21:13.561509 37235 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:17.404337 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:17.404392 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.367s I1031 23:21:17.404472 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:21:17.405094 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:21:17.405128 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:21:17.405418 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:21:17.405443 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:21:17.405468 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:17.405675 37249 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.856s I1031 23:21:17.405702 37249 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:28.316012 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:28.316062 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.988s I1031 23:21:28.316118 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:21:28.316632 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:21:28.316659 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:21:28.316885 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:21:28.316933 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:21:28.316944 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:28.317200 37488 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.519s I1031 23:21:28.317221 37488 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:31.027395 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:31.027438 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.355s I1031 23:21:31.027495 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:21:31.028090 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:21:31.028118 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:21:31.028398 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:21:31.028422 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:21:31.028445 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:31.028635 37505 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.532s I1031 23:21:31.028661 37505 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:31.083050 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:31.083076 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.403s I1031 23:21:31.083122 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:21:31.083626 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:21:31.083652 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:21:31.083840 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:21:31.083938 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:21:31.083961 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:31.084198 37506 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.483s I1031 23:21:31.084223 37506 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:35.136523 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:35.136566 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.056s I1031 23:21:35.136634 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:21:35.137210 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:21:35.137236 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:21:35.137404 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:21:35.137595 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:21:35.137622 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:35.138137 37535 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.451s I1031 23:21:35.138159 37535 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:38.115936 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:38.115980 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.397s I1031 23:21:38.116050 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:21:38.116533 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:21:38.116561 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:21:38.116771 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:21:38.116801 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:21:38.116817 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:38.117013 37559 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.156s I1031 23:21:38.117040 37559 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:40.662288 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:40.662344 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.940s I1031 23:21:40.662397 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:21:40.662900 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:21:40.662925 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:21:40.663170 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:21:40.663209 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:21:40.663223 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:40.663565 37571 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.472s I1031 23:21:40.663595 37571 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:44.981603 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:44.981659 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.271s I1031 23:21:44.981724 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:21:44.982368 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:21:44.982401 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:21:44.982647 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:21:44.982686 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:21:44.982702 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:44.983031 37587 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.853s I1031 23:21:44.983058 37587 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:45.094113 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:45.094151 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.639s I1031 23:21:45.094194 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:21:45.094643 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:21:45.094667 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:21:45.094887 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:21:45.094991 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:21:45.095027 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:45.095203 37588 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.873s I1031 23:21:45.095224 37588 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:51.774703 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:51.774755 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.913s I1031 23:21:51.774813 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:21:51.775283 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:21:51.775307 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:21:51.775537 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:21:51.775578 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:21:51.775590 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:51.775933 37629 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.251s I1031 23:21:51.775960 37629 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:52.649118 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:52.649169 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.091s I1031 23:21:52.649224 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:21:52.649734 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:21:52.649768 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:21:52.649993 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:21:52.650034 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:21:52.650046 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:52.650542 37632 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.773s I1031 23:21:52.650564 37632 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:56.071238 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:56.071279 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.785s I1031 23:21:56.071338 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:21:56.071842 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:21:56.071877 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:21:56.072118 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:21:56.072151 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:21:56.072172 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:56.072518 37644 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.761s I1031 23:21:56.072558 37644 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:57.060427 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:57.060468 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.081s I1031 23:21:57.060508 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:21:57.061069 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:21:57.061105 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:21:57.061344 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:21:57.061424 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:21:57.061445 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:57.061689 37647 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 18.142s I1031 23:21:57.061725 37647 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:21:58.486428 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:21:58.486479 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.392s I1031 23:21:58.486541 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:21:58.487042 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:21:58.487079 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:21:58.487263 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:21:58.487308 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:21:58.487323 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:21:58.487560 37672 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.290s I1031 23:21:58.487581 37672 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:04.939205 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:04.939255 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.655s I1031 23:22:04.939317 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:22:04.939884 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:22:04.939910 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:22:04.940145 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:22:04.940186 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:22:04.940196 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:04.940407 37716 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.030s I1031 23:22:04.940434 37716 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:12.772459 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:12.772513 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.402s I1031 23:22:12.772567 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:22:12.773068 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:22:12.773104 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:22:12.773325 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:22:12.773367 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:22:12.773387 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:12.773607 37762 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.219s I1031 23:22:12.773627 37762 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:14.493782 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:14.493831 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.338s I1031 23:22:14.493885 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:22:14.494436 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:22:14.494464 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:22:14.494714 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:22:14.494745 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:22:14.494760 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:14.495038 37772 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 13.722s I1031 23:22:14.495076 37772 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:16.516587 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:16.516644 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.598s I1031 23:22:16.516702 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:22:16.517194 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:22:16.517235 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:22:16.517498 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:22:16.517521 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:22:16.517549 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:16.517844 37782 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.605s I1031 23:22:16.517870 37782 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:16.733325 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:16.733363 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.554s I1031 23:22:16.733400 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:22:16.733858 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:22:16.733893 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:22:16.734078 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:22:16.734102 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:22:16.734122 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:16.734464 37783 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.927s I1031 23:22:16.734486 37783 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:22:21.496270 30391 log.cc:565] Time spent T 3a949c88a8864d509b058fddddebc6d2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.112s user 0.000s sys 0.000s W1031 23:22:21.496309 30386 log.cc:565] Time spent T 3123639d9835456b9f5dab3f7dd7ebd9 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.206s user 0.000s sys 0.000s I1031 23:22:28.914119 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:28.914175 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.363s I1031 23:22:28.914227 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:22:28.914732 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:22:28.914757 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:22:28.915040 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:22:28.915066 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:22:28.915083 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:28.915338 38041 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.419s I1031 23:22:28.915365 38041 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:29.944751 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:29.944782 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.276s I1031 23:22:29.944823 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:22:29.945328 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:22:29.945364 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:22:29.945648 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:22:29.945716 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:22:29.945744 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:29.945925 38054 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.229s I1031 23:22:29.945946 38054 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:31.762933 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:31.762974 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.603s I1031 23:22:31.763047 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:22:31.763535 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:22:31.763561 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:22:31.763806 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:22:31.763844 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:22:31.763855 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:31.763979 38070 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 5.422s I1031 23:22:31.764000 38070 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:36.209045 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:36.209097 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.766s I1031 23:22:36.209146 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:22:36.209631 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:22:36.209655 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:22:36.209863 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:22:36.209903 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:22:36.209924 32772 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:36.210065 38092 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.064s I1031 23:22:36.210093 38092 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:39.007890 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:39.007944 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.605s I1031 23:22:39.008004 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:22:39.008527 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:22:39.008563 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:22:39.008781 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:22:39.008828 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:22:39.008843 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:39.009022 38116 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.553s I1031 23:22:39.009042 38116 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:43.489388 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:43.489449 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.333s I1031 23:22:43.489511 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:22:43.490042 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:22:43.490070 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:22:43.490269 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:22:43.490314 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:22:43.490330 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:43.490520 38129 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.724s I1031 23:22:43.490541 38129 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:43.573045 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:43.573072 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.290s I1031 23:22:43.573113 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:22:43.573559 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:22:43.573585 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:22:43.573781 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:22:43.573870 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:22:43.573905 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:43.574172 38130 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.926s I1031 23:22:43.574192 38130 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:47.193912 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:47.193959 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.530s I1031 23:22:47.194038 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:22:47.194739 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:22:47.194767 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:22:47.195015 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:22:47.195068 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:22:47.195096 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:47.195297 38144 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.195s I1031 23:22:47.195339 38144 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:52.798583 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:52.798626 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.798s I1031 23:22:52.798686 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:22:52.799194 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:22:52.799222 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:22:52.799383 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:22:52.799434 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:22:52.799448 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:52.799571 38177 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.008s I1031 23:22:52.799592 38177 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:53.376982 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:53.377017 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.740s I1031 23:22:53.377059 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:22:53.377480 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:22:53.377506 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:22:53.377746 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found W1031 23:22:53.377805 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found I1031 23:22:53.377838 32772 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:53.378420 38180 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.080s I1031 23:22:53.378442 38180 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:54.927434 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:54.927469 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.731s I1031 23:22:54.927516 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:22:54.928005 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:22:54.928032 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:22:54.928174 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:22:54.928339 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:22:54.928361 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:54.928488 38185 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.916s I1031 23:22:54.928514 38185 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:57.721973 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:57.722030 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 12.735s I1031 23:22:57.722096 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:22:57.722641 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:22:57.722677 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:22:57.722923 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found W1031 23:22:57.722966 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found I1031 23:22:57.722980 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:57.723125 38190 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 4.794s I1031 23:22:57.723155 38190 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:22:58.978572 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:22:58.978636 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.392s I1031 23:22:58.978708 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:22:58.979267 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:22:58.979295 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:22:58.979521 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:22:58.979571 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:22:58.979588 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:22:58.979836 38209 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 10.155s I1031 23:22:58.979877 38209 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:23:04.491746 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:23:04.491799 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.219s I1031 23:23:04.491863 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:23:04.492354 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:23:04.492384 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:23:04.492602 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:23:04.492646 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:23:04.492655 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:23:04.492995 38233 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 6.482s I1031 23:23:04.493024 38233 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:23:06.044479 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:23:06.044523 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.388s I1031 23:23:06.044600 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:23:06.045150 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:23:06.045177 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:23:06.045377 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:23:06.045413 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:23:06.045433 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:23:06.045677 38237 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 7.531s I1031 23:23:06.045717 38237 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:23:10.690963 37655 raft_consensus.cc:411] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:23:10.691016 37655 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.873s I1031 23:23:10.691073 37655 raft_consensus.cc:435] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "daba39963d4346e1816089fd3a5442b5" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st09.bj" port: 18700 } } peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } I1031 23:23:10.691644 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer daba39963d4346e1816089fd3a5442b5 I1031 23:23:10.691684 37655 leader_election.cc:216] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b W1031 23:23:10.691825 32772 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:23:10.691928 32770 leader_election.cc:278] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daba39963d4346e1816089fd3a5442b5: Not found: Tablet not found I1031 23:23:10.691949 32770 leader_election.cc:243] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:23:10.692237 38292 raft_consensus.cc:2162] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 16.235s I1031 23:23:10.692265 38292 raft_consensus.cc:1908] T bade583b5fea4f3781e889af8cd881ed P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:23:10.838050 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:23:10.838088 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 11.335s I1031 23:23:10.838130 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:23:10.838620 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:23:10.838654 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:23:10.838876 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:23:10.838985 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:23:10.839009 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:23:10.839435 38293 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.824s I1031 23:23:10.839455 38293 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:23:12.611769 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:23:12.611812 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.255s I1031 23:23:12.611877 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st02.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:23:12.612402 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 0a8bbcbbb5a6459aa5258464755db3bb I1031 23:23:12.612432 37675 leader_election.cc:216] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:23:12.612642 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a8bbcbbb5a6459aa5258464755db3bb: Not found: Tablet not found W1031 23:23:12.612743 32773 leader_election.cc:278] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:23:12.612766 32773 leader_election.cc:243] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:23:12.612969 38326 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 8.726s I1031 23:23:12.612990 38326 raft_consensus.cc:1908] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:23:15.102932 37685 raft_consensus.cc:411] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:23:15.102974 37685 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.905s I1031 23:23:15.103036 37685 raft_consensus.cc:435] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } peers { permanent_uuid: "044f1da9a27c46acb82b1386f829f4dc" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st03.bj" port: 18700 } } I1031 23:23:15.103641 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:23:15.103667 37685 leader_election.cc:216] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 044f1da9a27c46acb82b1386f829f4dc W1031 23:23:15.103888 32772 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:23:15.103925 32773 leader_election.cc:278] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 044f1da9a27c46acb82b1386f829f4dc: Not found: Tablet not found I1031 23:23:15.103950 32773 leader_election.cc:243] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:23:15.104161 38347 raft_consensus.cc:2162] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 9.485s I1031 23:23:15.104187 38347 raft_consensus.cc:1908] T a56a9d551d3746e59739adec9d8125ea P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:23:16.274540 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:23:16.274596 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 15.358s I1031 23:23:16.274652 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:23:16.275183 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:23:16.275212 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:23:16.275393 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:23:16.275511 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:23:16.275538 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:23:16.275713 38357 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 3.571s I1031 23:23:16.275733 38357 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I1031 23:23:21.724016 31124 raft_consensus.cc:411] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:23:21.724072 31124 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 17.317s I1031 23:23:21.724146 31124 raft_consensus.cc:435] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193181be29284287b25df2ee92938f0b" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st08.bj" port: 18700 } } peers { permanent_uuid: "d3eb30bd1bc34b95902fa61724239553" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st05.bj" port: 18700 } } peers { permanent_uuid: "23f962e4a1744381ad5fa0d2d8b10241" member_type: VOTER last_known_addr { host: "c3-kudu-tst-st07.bj" port: 18700 } } I1031 23:23:21.724786 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 193181be29284287b25df2ee92938f0b I1031 23:23:21.724835 31124 leader_election.cc:216] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d3eb30bd1bc34b95902fa61724239553 W1031 23:23:21.725019 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 193181be29284287b25df2ee92938f0b: Not found: Tablet not found W1031 23:23:21.725157 32772 leader_election.cc:278] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3eb30bd1bc34b95902fa61724239553: Not found: Tablet not found I1031 23:23:21.725188 32772 leader_election.cc:243] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I1031 23:23:21.725540 38413 raft_consensus.cc:2162] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.542s I1031 23:23:21.725564 38413 raft_consensus.cc:1908] T 0cbdac8627e144b4a2e5f080abda7766 P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W1031 23:23:22.056455 30381 log.cc:565] Time spent T 2765976a053c4287874c0cb2fb7781b2 P 23f962e4a1744381ad5fa0d2d8b10241: Append to log took a long time: real 0.069s user 0.000s sys 0.000s I1031 23:23:22.991216 37675 raft_consensus.cc:411] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I1031 23:23:22.991283 37675 raft_consensus.cc:2162] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 19.568s I1031 23:23:22.991364 37675 raft_consensus.cc:435] T ba08e192cf754b30acaccc0ced6d0c1c P 23f962e4a1744381ad5fa0d2d8b10241 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8bbcbbb5a6459aa5258464755db3bb" member_type: VOTER last