[==========] Running 3 tests from 1 test case. [----------] Global test environment set-up. [----------] 3 tests from DeleteTabletITest [ RUN ] DeleteTabletITest.TestDeleteFailedReplica I0516 22:02:31.446710 17760 internal_mini_cluster.cc:144] Creating distributed mini masters. Addrs: 127.17.88.62:37709 I0516 22:02:31.452432 17760 system_ntp.cc:143] NTP initialized. Skew: 500ppm Current error: 1236488us I0516 22:02:31.453029 17760 fs_manager.cc:260] Metadata directory not provided I0516 22:02:31.453099 17760 fs_manager.cc:266] Using write-ahead log directory (fs_wal_dir) as metadata directory I0516 22:02:31.453315 17760 server_base.cc:433] Could not load existing FS layout: Not found: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestDeleteFailedReplica.1526508151408653-17760/minicluster-data/master-0-root/instance: No such file or directory (error 2) I0516 22:02:31.453403 17760 server_base.cc:434] Attempting to create new FS layout instead I0516 22:02:31.457098 17760 fs_manager.cc:595] Generated new instance metadata in path /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestDeleteFailedReplica.1526508151408653-17760/minicluster-data/master-0-root/instance: uuid: "43fde892c62c47fc9eeadad46ff29dab" format_stamp: "Formatted at 2018-05-16 22:02:31 on dist-test-slave-dist-test-slave-gwpd" I0516 22:02:31.464550 17760 fs_manager.cc:495] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s I0516 22:02:31.465406 17760 env_posix.cc:1643] Not raising this process' open files per process limit of 65536; it is already as high as it can go I0516 22:02:31.465884 17760 file_cache.cc:470] Constructed file cache lbm with capacity 26214 I0516 22:02:31.469375 17760 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0516 22:02:31.469447 17760 fs_manager.cc:428] Opened local filesystem: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestDeleteFailedReplica.1526508151408653-17760/minicluster-data/master-0-root uuid: "43fde892c62c47fc9eeadad46ff29dab" format_stamp: "Formatted at 2018-05-16 22:02:31 on dist-test-slave-dist-test-slave-gwpd" I0516 22:02:31.469568 17760 fs_report.cc:347] Block manager report -------------------- 1 data directories: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestDeleteFailedReplica.1526508151408653-17760/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0516 22:02:31.488905 17760 env_posix.cc:1643] Not raising this process' running threads per effective uid limit of 60284; it is already as high as it can go I0516 22:02:31.500629 17760 rpc_server.cc:205] RPC server started. Bound to: 127.17.88.62:37709 I0516 22:02:31.501144 17760 webserver.cc:173] Starting webserver on 127.17.88.62:0 I0516 22:02:31.501179 17760 webserver.cc:184] Document root disabled I0516 22:02:31.501907 17760 webserver.cc:311] Webserver started. Bound to: http://127.17.88.62:60987/ I0516 22:02:31.505426 17819 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:31.515612 17819 tablet_bootstrap.cc:436] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab: Bootstrap starting. I0516 22:02:31.517994 17819 tablet_bootstrap.cc:587] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab: No blocks or log segments found. Creating new log. I0516 22:02:31.518816 17819 log.cc:520] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab: Log is configured to *not* fsync() on all Append() calls I0516 22:02:31.520550 17819 tablet_bootstrap.cc:436] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab: No bootstrap required, opened a new log I0516 22:02:31.526216 17819 raft_consensus.cc:303] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43fde892c62c47fc9eeadad46ff29dab" member_type: VOTER } I0516 22:02:31.526479 17819 raft_consensus.cc:329] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:31.526531 17819 raft_consensus.cc:604] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43fde892c62c47fc9eeadad46ff29dab, State: Initialized, Role: FOLLOWER I0516 22:02:31.527040 17819 consensus_queue.cc:227] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43fde892c62c47fc9eeadad46ff29dab" member_type: VOTER } I0516 22:02:31.527187 17819 raft_consensus.cc:343] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0516 22:02:31.527285 17819 raft_consensus.cc:435] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0516 22:02:31.527374 17819 raft_consensus.cc:2704] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab: Snoozing failure detection for 1.822s (starting election) I0516 22:02:31.527451 17819 raft_consensus.cc:2756] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:31.528729 17819 raft_consensus.cc:457] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43fde892c62c47fc9eeadad46ff29dab" member_type: VOTER } I0516 22:02:31.529189 17819 leader_election.cc:270] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0516 22:02:31.530001 17821 raft_consensus.cc:2704] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab: Snoozing failure detection for 1.674s (election complete) I0516 22:02:31.530161 17821 raft_consensus.cc:2511] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [term 1 FOLLOWER]: Leader election won for term 1 I0516 22:02:31.530678 17821 raft_consensus.cc:571] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [term 1 LEADER]: Becoming Leader. State: Replica: 43fde892c62c47fc9eeadad46ff29dab, State: Running, Role: LEADER I0516 22:02:31.531080 17821 consensus_queue.cc:204] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43fde892c62c47fc9eeadad46ff29dab" member_type: VOTER } I0516 22:02:31.533305 17819 sys_catalog.cc:335] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "43fde892c62c47fc9eeadad46ff29dab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43fde892c62c47fc9eeadad46ff29dab" member_type: VOTER } } I0516 22:02:31.533248 17822 sys_catalog.cc:335] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43fde892c62c47fc9eeadad46ff29dab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43fde892c62c47fc9eeadad46ff29dab" member_type: VOTER } } I0516 22:02:31.533486 17819 sys_catalog.cc:338] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [sys.catalog]: This master's current role is: LEADER I0516 22:02:31.533504 17822 sys_catalog.cc:338] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [sys.catalog]: This master's current role is: LEADER I0516 22:02:31.533630 17823 sys_catalog.cc:335] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43fde892c62c47fc9eeadad46ff29dab. Latest consensus state: current_term: 1 leader_uuid: "43fde892c62c47fc9eeadad46ff29dab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43fde892c62c47fc9eeadad46ff29dab" member_type: VOTER } } I0516 22:02:31.533808 17823 sys_catalog.cc:338] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [sys.catalog]: This master's current role is: LEADER I0516 22:02:31.534601 17819 sys_catalog.cc:422] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [sys.catalog]: configured and running, proceeding with master startup. I0516 22:02:31.534907 17760 internal_mini_cluster.cc:164] Waiting to initialize catalog manager on master 0 W0516 22:02:31.538039 17825 catalog_manager.cc:1047] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0516 22:02:31.538121 17825 catalog_manager.cc:562] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0516 22:02:31.538202 17826 catalog_manager.cc:1001] Loading table and tablet metadata into memory... I0516 22:02:31.539649 17826 catalog_manager.cc:1012] Initializing Kudu internal certificate authority... I0516 22:02:31.573842 17826 catalog_manager.cc:899] Generated new certificate authority record I0516 22:02:31.575079 17826 catalog_manager.cc:1021] Loading token signing keys... I0516 22:02:31.585227 17826 catalog_manager.cc:3962] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab: Generated new TSK 0 I0516 22:02:31.601786 17760 system_ntp.cc:143] NTP initialized. Skew: 500ppm Current error: 1236488us I0516 22:02:31.601963 17760 fs_manager.cc:260] Metadata directory not provided I0516 22:02:31.602022 17760 fs_manager.cc:266] Using write-ahead log directory (fs_wal_dir) as metadata directory I0516 22:02:31.602113 17760 server_base.cc:433] Could not load existing FS layout: Not found: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestDeleteFailedReplica.1526508151408653-17760/minicluster-data/ts-0-root/instance: No such file or directory (error 2) I0516 22:02:31.602159 17760 server_base.cc:434] Attempting to create new FS layout instead I0516 22:02:31.604010 17760 fs_manager.cc:595] Generated new instance metadata in path /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestDeleteFailedReplica.1526508151408653-17760/minicluster-data/ts-0-root/instance: uuid: "d0777afcb6ec4bbba96b9e9c072c6431" format_stamp: "Formatted at 2018-05-16 22:02:31 on dist-test-slave-dist-test-slave-gwpd" I0516 22:02:31.619937 17760 fs_manager.cc:495] Time spent creating directory manager: real 0.016s user 0.000s sys 0.016s I0516 22:02:31.621047 17760 file_cache.cc:470] Constructed file cache lbm with capacity 26214 I0516 22:02:31.623749 17760 fs_manager.cc:417] Time spent opening block manager: real 0.001s user 0.004s sys 0.000s I0516 22:02:31.623801 17760 fs_manager.cc:428] Opened local filesystem: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestDeleteFailedReplica.1526508151408653-17760/minicluster-data/ts-0-root uuid: "d0777afcb6ec4bbba96b9e9c072c6431" format_stamp: "Formatted at 2018-05-16 22:02:31 on dist-test-slave-dist-test-slave-gwpd" I0516 22:02:31.623978 17760 fs_report.cc:347] Block manager report -------------------- 1 data directories: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestDeleteFailedReplica.1526508151408653-17760/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0516 22:02:31.665340 17760 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0516 22:02:31.743741 17760 rpc_server.cc:205] RPC server started. Bound to: 127.17.88.1:40488 I0516 22:02:31.744009 17760 webserver.cc:173] Starting webserver on 127.17.88.1:0 I0516 22:02:31.744048 17760 webserver.cc:184] Document root disabled I0516 22:02:31.744592 17760 webserver.cc:311] Webserver started. Bound to: http://127.17.88.1:40427/ I0516 22:02:31.757977 17894 heartbeater.cc:346] Connected to a master server at 127.17.88.62:37709 I0516 22:02:31.758175 17894 heartbeater.cc:426] Registering TS with master... I0516 22:02:31.758628 17894 heartbeater.cc:475] Master 127.17.88.62:37709 requested a full tablet report, sending... I0516 22:02:31.760361 17786 ts_manager.cc:81] Registered new tserver with Master: d0777afcb6ec4bbba96b9e9c072c6431 (127.17.88.1:40488) I0516 22:02:31.760771 17760 internal_mini_cluster.cc:326] 1 TS(s) registered with all masters after 0.015495272s I0516 22:02:31.762012 17786 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34065 I0516 22:02:31.793536 17760 test_util.cc:200] Using random seed: -534616217 I0516 22:02:31.844826 17786 catalog_manager.cc:1315] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34068: name: "test-workload" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0516 22:02:31.871778 17861 tablet_service.cc:760] Processing CreateTablet for tablet 4be8e8a009f14d5cb8523438f316f539 (table=test-workload [id=ea7e21728c89498d83277a52c9146e3a]), partition=RANGE (key) PARTITION UNBOUNDED I0516 22:02:31.872200 17861 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 4be8e8a009f14d5cb8523438f316f539. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:31.875310 17861 ts_tablet_manager.cc:1173] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:31.876224 17912 ts_tablet_manager.cc:1028] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Bootstrapping tablet I0516 22:02:31.876499 17912 tablet_bootstrap.cc:436] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Bootstrap starting. I0516 22:02:31.878141 17912 tablet_bootstrap.cc:587] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: No blocks or log segments found. Creating new log. I0516 22:02:31.879767 17912 tablet_bootstrap.cc:436] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: No bootstrap required, opened a new log I0516 22:02:31.879894 17912 ts_tablet_manager.cc:1045] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s I0516 22:02:31.880380 17912 raft_consensus.cc:303] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0777afcb6ec4bbba96b9e9c072c6431" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 40488 } } I0516 22:02:31.880579 17912 raft_consensus.cc:329] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:31.880614 17912 raft_consensus.cc:604] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0777afcb6ec4bbba96b9e9c072c6431, State: Initialized, Role: FOLLOWER I0516 22:02:31.880762 17912 consensus_queue.cc:227] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0777afcb6ec4bbba96b9e9c072c6431" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 40488 } } I0516 22:02:31.880875 17912 raft_consensus.cc:343] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0516 22:02:31.880920 17912 raft_consensus.cc:435] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0516 22:02:31.880959 17912 raft_consensus.cc:2704] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Snoozing failure detection for 2.182s (starting election) I0516 22:02:31.881007 17912 raft_consensus.cc:2756] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:31.882403 17912 raft_consensus.cc:457] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0777afcb6ec4bbba96b9e9c072c6431" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 40488 } } I0516 22:02:31.882577 17912 leader_election.cc:270] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0516 22:02:31.883169 17914 raft_consensus.cc:2704] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Snoozing failure detection for 1.876s (election complete) I0516 22:02:31.883311 17914 raft_consensus.cc:2511] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [term 1 FOLLOWER]: Leader election won for term 1 I0516 22:02:31.883471 17894 heartbeater.cc:467] Master 127.17.88.62:37709 was elected leader, sending a full tablet report... I0516 22:02:31.883643 17912 ts_tablet_manager.cc:1073] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s I0516 22:02:31.883774 17914 raft_consensus.cc:571] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [term 1 LEADER]: Becoming Leader. State: Replica: d0777afcb6ec4bbba96b9e9c072c6431, State: Running, Role: LEADER I0516 22:02:31.883971 17914 consensus_queue.cc:204] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0777afcb6ec4bbba96b9e9c072c6431" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 40488 } } I0516 22:02:31.886162 17786 catalog_manager.cc:3686] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 reported cstate change: term changed from 0 to 1, leader changed from to d0777afcb6ec4bbba96b9e9c072c6431 (127.17.88.1). New cstate: current_term: 1 leader_uuid: "d0777afcb6ec4bbba96b9e9c072c6431" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0777afcb6ec4bbba96b9e9c072c6431" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 40488 } health_report { overall_health: HEALTHY } } } I0516 22:02:31.935730 17760 tablet.cc:1152] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Flush: entering stage 1 (old memrowset already frozen for inserts) I0516 22:02:31.935796 17760 compaction.cc:913] Selected 1 rowsets to compact: I0516 22:02:31.935843 17760 compaction.cc:916] memrowset(current size on disk: ~0 bytes) I0516 22:02:31.935878 17760 tablet.cc:1154] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Memstore in-memory size: 31639 bytes I0516 22:02:31.935922 17760 tablet.cc:1443] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6252577390317494272 or (T in {6252577390317494272})}] I0516 22:02:31.940707 17760 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0516 22:02:31.956487 17760 tablet.cc:1528] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0516 22:02:31.956949 17760 tablet.cc:1583] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0516 22:02:31.957005 17760 tablet.cc:1585] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6252577390317494272 or (T in {6252577390317494272})}] I0516 22:02:31.963609 17760 tablet.cc:1633] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Flush successful on 300 rows (12537 bytes) I0516 22:02:31.964174 17760 master.cc:249] Master@127.17.88.62:37709 shutting down... I0516 22:02:31.971529 17760 raft_consensus.cc:2016] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [term 1 LEADER]: Raft consensus shutting down. I0516 22:02:31.971783 17760 raft_consensus.cc:2043] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab [term 1 FOLLOWER]: Raft consensus is shut down! I0516 22:02:31.971892 17760 tablet_replica.cc:261] T 00000000000000000000000000000000 P 43fde892c62c47fc9eeadad46ff29dab: stopping tablet replica I0516 22:02:31.972056 17760 maintenance_manager.cc:237] P 43fde892c62c47fc9eeadad46ff29dab: Unregistered op CompactRowSetsOp(00000000000000000000000000000000) I0516 22:02:31.972126 17760 maintenance_manager.cc:237] P 43fde892c62c47fc9eeadad46ff29dab: Unregistered op MinorDeltaCompactionOp(00000000000000000000000000000000) I0516 22:02:31.972172 17760 maintenance_manager.cc:237] P 43fde892c62c47fc9eeadad46ff29dab: Unregistered op MajorDeltaCompactionOp(00000000000000000000000000000000) I0516 22:02:31.972206 17760 maintenance_manager.cc:237] P 43fde892c62c47fc9eeadad46ff29dab: Unregistered op UndoDeltaBlockGCOp(00000000000000000000000000000000) I0516 22:02:31.972282 17760 maintenance_manager.cc:237] P 43fde892c62c47fc9eeadad46ff29dab: Unregistered op FlushMRSOp(00000000000000000000000000000000) I0516 22:02:31.972312 17760 maintenance_manager.cc:237] P 43fde892c62c47fc9eeadad46ff29dab: Unregistered op FlushDeltaMemStoresOp(00000000000000000000000000000000) I0516 22:02:31.972350 17760 maintenance_manager.cc:237] P 43fde892c62c47fc9eeadad46ff29dab: Unregistered op LogGCOp(00000000000000000000000000000000) I0516 22:02:31.987593 17760 master.cc:260] Master@127.17.88.62:37709 shutdown complete. I0516 22:02:31.992295 17760 tablet_server.cc:144] TabletServer shutting down... I0516 22:02:31.997030 17895 maintenance_manager.cc:304] P d0777afcb6ec4bbba96b9e9c072c6431: Scheduling UndoDeltaBlockGCOp(4be8e8a009f14d5cb8523438f316f539): 2803 bytes on disk I0516 22:02:31.998929 17839 maintenance_manager.cc:494] P d0777afcb6ec4bbba96b9e9c072c6431: UndoDeltaBlockGCOp(4be8e8a009f14d5cb8523438f316f539) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":69,"lbm_reads_lt_1ms":4} I0516 22:02:32.002187 17760 ts_tablet_manager.cc:1118] Shutting down tablet manager... I0516 22:02:32.002459 17760 tablet_replica.cc:261] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: stopping tablet replica I0516 22:02:32.002526 17760 maintenance_manager.cc:237] P d0777afcb6ec4bbba96b9e9c072c6431: Unregistered op CompactRowSetsOp(4be8e8a009f14d5cb8523438f316f539) I0516 22:02:32.002573 17760 maintenance_manager.cc:237] P d0777afcb6ec4bbba96b9e9c072c6431: Unregistered op MinorDeltaCompactionOp(4be8e8a009f14d5cb8523438f316f539) I0516 22:02:32.002619 17760 maintenance_manager.cc:237] P d0777afcb6ec4bbba96b9e9c072c6431: Unregistered op MajorDeltaCompactionOp(4be8e8a009f14d5cb8523438f316f539) I0516 22:02:32.002661 17760 maintenance_manager.cc:237] P d0777afcb6ec4bbba96b9e9c072c6431: Unregistered op UndoDeltaBlockGCOp(4be8e8a009f14d5cb8523438f316f539) I0516 22:02:32.002709 17760 maintenance_manager.cc:237] P d0777afcb6ec4bbba96b9e9c072c6431: Unregistered op FlushMRSOp(4be8e8a009f14d5cb8523438f316f539) I0516 22:02:32.002746 17760 maintenance_manager.cc:237] P d0777afcb6ec4bbba96b9e9c072c6431: Unregistered op FlushDeltaMemStoresOp(4be8e8a009f14d5cb8523438f316f539) I0516 22:02:32.002774 17760 maintenance_manager.cc:237] P d0777afcb6ec4bbba96b9e9c072c6431: Unregistered op LogGCOp(4be8e8a009f14d5cb8523438f316f539) I0516 22:02:32.002820 17760 raft_consensus.cc:2016] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [term 1 LEADER]: Raft consensus shutting down. I0516 22:02:32.002925 17760 raft_consensus.cc:2043] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [term 1 FOLLOWER]: Raft consensus is shut down! I0516 22:02:32.017195 17760 tablet_server.cc:157] TabletServer shutdown complete. I0516 22:02:32.017257 17760 tablet_server.cc:144] TabletServer shutting down... I0516 22:02:32.017408 17760 tablet_server.cc:157] TabletServer shutdown complete. I0516 22:02:32.022087 17760 system_ntp.cc:143] NTP initialized. Skew: 500ppm Current error: 1236988us I0516 22:02:32.022250 17760 fs_manager.cc:260] Metadata directory not provided I0516 22:02:32.022289 17760 fs_manager.cc:263] Using existing metadata directory in first data directory I0516 22:02:32.023744 17760 fs_manager.cc:397] Time spent opening directory manager: real 0.001s user 0.004s sys 0.000s I0516 22:02:32.025099 17760 file_cache.cc:470] Constructed file cache lbm with capacity 26214 I0516 22:02:32.030246 17760 fs_manager.cc:417] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s I0516 22:02:32.030297 17760 fs_manager.cc:428] Opened local filesystem: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestDeleteFailedReplica.1526508151408653-17760/minicluster-data/ts-0-root uuid: "d0777afcb6ec4bbba96b9e9c072c6431" format_stamp: "Formatted at 2018-05-16 22:02:31 on dist-test-slave-dist-test-slave-gwpd" I0516 22:02:32.030405 17760 fs_report.cc:347] Block manager report -------------------- 1 data directories: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestDeleteFailedReplica.1526508151408653-17760/minicluster-data/ts-0-root/data Total live blocks: 5 Total live bytes: 15340 Total live bytes (after alignment): 28672 Total number of LBM containers: 6 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0516 22:02:32.041236 17760 ts_tablet_manager.cc:344] Loading tablet metadata (0/1 complete) I0516 22:02:32.041293 17760 ts_tablet_manager.cc:1005] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Loading tablet metadata I0516 22:02:32.043694 17760 ts_tablet_manager.cc:356] Loaded tablet metadata (1 live tablets) I0516 22:02:32.045296 17760 ts_tablet_manager.cc:1173] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.045647 17936 ts_tablet_manager.cc:1028] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Bootstrapping tablet I0516 22:02:32.045872 17936 tablet_bootstrap.cc:436] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Bootstrap starting. W0516 22:02:32.050683 17936 log.cc:1128] Error closing log: Illegal state: Log not open. State: 0 E0516 22:02:32.051512 17936 ts_tablet_manager.cc:1066] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Tablet failed to bootstrap: IO error: Failed log replay. Reason: Failed to open new log: Insufficient disk space to allocate 8388608 bytes under path /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestDeleteFailedReplica.1526508151408653-17760/minicluster-data/ts-0-root/wals/4be8e8a009f14d5cb8523438f316f539/.kudutmp.newsegmentlHIXZF (46657662976 bytes available vs 9223372036854775807 bytes reserved) (error 28) I0516 22:02:32.051719 17936 ts_tablet_manager.cc:1045] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s I0516 22:02:32.051854 17936 tablet_replica.cc:261] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: stopping tablet replica I0516 22:02:32.051957 17936 raft_consensus.cc:2016] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [term 1 FOLLOWER]: Raft consensus shutting down. I0516 22:02:32.052052 17936 raft_consensus.cc:2043] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431 [term 1 FOLLOWER]: Raft consensus is shut down! I0516 22:02:32.058583 17760 rpc_server.cc:205] RPC server started. Bound to: 127.17.88.1:40488 I0516 22:02:32.059062 17760 webserver.cc:173] Starting webserver on 127.17.88.1:40427 I0516 22:02:32.059094 17760 webserver.cc:184] Document root disabled I0516 22:02:32.075407 17760 webserver.cc:311] Webserver started. Bound to: http://127.17.88.1:40427/ W0516 22:02:32.083458 17992 heartbeater.cc:587] Failed to heartbeat to 127.17.88.62:37709: Network error: Failed to ping master at 127.17.88.62:37709: Client connection negotiation failed: client connection to 127.17.88.62:37709: connect: Connection refused (error 111) W0516 22:02:32.084156 17992 heartbeater.cc:587] Failed to heartbeat to 127.17.88.62:37709: Network error: Failed to ping master at 127.17.88.62:37709: Client connection negotiation failed: client connection to 127.17.88.62:37709: connect: Connection refused (error 111) W0516 22:02:32.084893 17992 heartbeater.cc:587] Failed to heartbeat to 127.17.88.62:37709: Network error: Failed to ping master at 127.17.88.62:37709: Client connection negotiation failed: client connection to 127.17.88.62:37709: connect: Connection refused (error 111) W0516 22:02:32.084970 17992 heartbeater.cc:380] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts. I0516 22:02:32.088582 17959 tablet_service.cc:801] Processing DeleteTablet for tablet 4be8e8a009f14d5cb8523438f316f539 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:44326 I0516 22:02:32.089275 17996 ts_tablet_manager.cc:1369] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Deleting tablet data with delete state TABLET_DATA_DELETED I0516 22:02:32.094272 17996 ts_tablet_manager.cc:1382] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown I0516 22:02:32.094424 17996 log.cc:981] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Deleting WAL directory at /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestDeleteFailedReplica.1526508151408653-17760/minicluster-data/ts-0-root/wals/4be8e8a009f14d5cb8523438f316f539 I0516 22:02:32.094729 17996 ts_tablet_manager.cc:1402] T 4be8e8a009f14d5cb8523438f316f539 P d0777afcb6ec4bbba96b9e9c072c6431: Deleting consensus metadata I0516 22:02:32.096599 17760 tablet_server.cc:144] TabletServer shutting down... I0516 22:02:32.107233 17760 ts_tablet_manager.cc:1118] Shutting down tablet manager... I0516 22:02:32.119976 17760 tablet_server.cc:157] TabletServer shutdown complete. I0516 22:02:32.120039 17760 tablet_server.cc:144] TabletServer shutting down... I0516 22:02:32.120163 17760 tablet_server.cc:157] TabletServer shutdown complete. [ OK ] DeleteTabletITest.TestDeleteFailedReplica (683 ms) [ RUN ] DeleteTabletITest.TestLeaderElectionDuringDeleteTablet I0516 22:02:32.128190 17760 internal_mini_cluster.cc:144] Creating distributed mini masters. Addrs: 127.17.88.62:39073 I0516 22:02:32.130048 17760 system_ntp.cc:143] NTP initialized. Skew: 500ppm Current error: 1236988us I0516 22:02:32.130224 17760 fs_manager.cc:260] Metadata directory not provided I0516 22:02:32.130270 17760 fs_manager.cc:266] Using write-ahead log directory (fs_wal_dir) as metadata directory I0516 22:02:32.130383 17760 server_base.cc:433] Could not load existing FS layout: Not found: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/master-0-root/instance: No such file or directory (error 2) I0516 22:02:32.130425 17760 server_base.cc:434] Attempting to create new FS layout instead I0516 22:02:32.132099 17760 fs_manager.cc:595] Generated new instance metadata in path /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/master-0-root/instance: uuid: "4a20469620e14a06b82e6ed021859746" format_stamp: "Formatted at 2018-05-16 22:02:32 on dist-test-slave-dist-test-slave-gwpd" I0516 22:02:32.135260 17760 fs_manager.cc:495] Time spent creating directory manager: real 0.003s user 0.000s sys 0.000s I0516 22:02:32.136085 17760 file_cache.cc:470] Constructed file cache lbm with capacity 26214 I0516 22:02:32.137894 17760 fs_manager.cc:417] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0516 22:02:32.137955 17760 fs_manager.cc:428] Opened local filesystem: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/master-0-root uuid: "4a20469620e14a06b82e6ed021859746" format_stamp: "Formatted at 2018-05-16 22:02:32 on dist-test-slave-dist-test-slave-gwpd" I0516 22:02:32.138042 17760 fs_report.cc:347] Block manager report -------------------- 1 data directories: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0516 22:02:32.207931 17760 rpc_server.cc:205] RPC server started. Bound to: 127.17.88.62:39073 I0516 22:02:32.208209 17760 webserver.cc:173] Starting webserver on 127.17.88.62:0 I0516 22:02:32.208254 17760 webserver.cc:184] Document root disabled I0516 22:02:32.208679 17760 webserver.cc:311] Webserver started. Bound to: http://127.17.88.62:50671/ I0516 22:02:32.209750 18051 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.213240 18051 tablet_bootstrap.cc:436] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746: Bootstrap starting. I0516 22:02:32.214390 18051 tablet_bootstrap.cc:587] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746: No blocks or log segments found. Creating new log. I0516 22:02:32.228075 18051 tablet_bootstrap.cc:436] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746: No bootstrap required, opened a new log I0516 22:02:32.228687 18051 raft_consensus.cc:303] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a20469620e14a06b82e6ed021859746" member_type: VOTER } I0516 22:02:32.228813 18051 raft_consensus.cc:329] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.228863 18051 raft_consensus.cc:604] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a20469620e14a06b82e6ed021859746, State: Initialized, Role: FOLLOWER I0516 22:02:32.229017 18051 consensus_queue.cc:227] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a20469620e14a06b82e6ed021859746" member_type: VOTER } I0516 22:02:32.229140 18051 raft_consensus.cc:343] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0516 22:02:32.229176 18051 raft_consensus.cc:435] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0516 22:02:32.229228 18051 raft_consensus.cc:2704] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746: Snoozing failure detection for 1.617s (starting election) I0516 22:02:32.229272 18051 raft_consensus.cc:2756] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.230883 18051 raft_consensus.cc:457] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a20469620e14a06b82e6ed021859746" member_type: VOTER } I0516 22:02:32.231036 18051 leader_election.cc:270] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0516 22:02:32.231530 18053 raft_consensus.cc:2704] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746: Snoozing failure detection for 1.690s (election complete) I0516 22:02:32.231696 18053 raft_consensus.cc:2511] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [term 1 FOLLOWER]: Leader election won for term 1 I0516 22:02:32.232080 18053 raft_consensus.cc:571] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [term 1 LEADER]: Becoming Leader. State: Replica: 4a20469620e14a06b82e6ed021859746, State: Running, Role: LEADER I0516 22:02:32.232275 18053 consensus_queue.cc:204] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a20469620e14a06b82e6ed021859746" member_type: VOTER } I0516 22:02:32.232918 18054 sys_catalog.cc:335] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a20469620e14a06b82e6ed021859746" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a20469620e14a06b82e6ed021859746" member_type: VOTER } } I0516 22:02:32.233016 18051 sys_catalog.cc:335] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "4a20469620e14a06b82e6ed021859746" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a20469620e14a06b82e6ed021859746" member_type: VOTER } } I0516 22:02:32.233111 18054 sys_catalog.cc:338] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [sys.catalog]: This master's current role is: LEADER I0516 22:02:32.233021 18055 sys_catalog.cc:335] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a20469620e14a06b82e6ed021859746. Latest consensus state: current_term: 1 leader_uuid: "4a20469620e14a06b82e6ed021859746" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a20469620e14a06b82e6ed021859746" member_type: VOTER } } I0516 22:02:32.233147 18051 sys_catalog.cc:338] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [sys.catalog]: This master's current role is: LEADER I0516 22:02:32.233170 18055 sys_catalog.cc:338] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [sys.catalog]: This master's current role is: LEADER I0516 22:02:32.233633 18051 sys_catalog.cc:422] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746 [sys.catalog]: configured and running, proceeding with master startup. I0516 22:02:32.234052 17760 internal_mini_cluster.cc:164] Waiting to initialize catalog manager on master 0 W0516 22:02:32.235276 18058 catalog_manager.cc:1047] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0516 22:02:32.235343 18058 catalog_manager.cc:562] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0516 22:02:32.235399 18057 catalog_manager.cc:1001] Loading table and tablet metadata into memory... I0516 22:02:32.236416 18057 catalog_manager.cc:1012] Initializing Kudu internal certificate authority... I0516 22:02:32.265748 18057 catalog_manager.cc:899] Generated new certificate authority record I0516 22:02:32.266598 18057 catalog_manager.cc:1021] Loading token signing keys... I0516 22:02:32.275506 18057 catalog_manager.cc:3962] T 00000000000000000000000000000000 P 4a20469620e14a06b82e6ed021859746: Generated new TSK 0 I0516 22:02:32.300252 17760 system_ntp.cc:143] NTP initialized. Skew: 500ppm Current error: 1236988us I0516 22:02:32.300453 17760 fs_manager.cc:260] Metadata directory not provided I0516 22:02:32.300499 17760 fs_manager.cc:266] Using write-ahead log directory (fs_wal_dir) as metadata directory I0516 22:02:32.300583 17760 server_base.cc:433] Could not load existing FS layout: Not found: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-0-root/instance: No such file or directory (error 2) I0516 22:02:32.300616 17760 server_base.cc:434] Attempting to create new FS layout instead I0516 22:02:32.302361 17760 fs_manager.cc:595] Generated new instance metadata in path /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-0-root/instance: uuid: "d7e4c153959b4c86b9dcb5a3441a879a" format_stamp: "Formatted at 2018-05-16 22:02:32 on dist-test-slave-dist-test-slave-gwpd" I0516 22:02:32.305434 17760 fs_manager.cc:495] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s I0516 22:02:32.306159 17760 file_cache.cc:470] Constructed file cache lbm with capacity 26214 I0516 22:02:32.308065 17760 fs_manager.cc:417] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0516 22:02:32.308121 17760 fs_manager.cc:428] Opened local filesystem: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-0-root uuid: "d7e4c153959b4c86b9dcb5a3441a879a" format_stamp: "Formatted at 2018-05-16 22:02:32 on dist-test-slave-dist-test-slave-gwpd" I0516 22:02:32.308203 17760 fs_report.cc:347] Block manager report -------------------- 1 data directories: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0516 22:02:32.324657 17760 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0516 22:02:32.335160 17760 rpc_server.cc:205] RPC server started. Bound to: 127.17.88.1:47831 I0516 22:02:32.335428 17760 webserver.cc:173] Starting webserver on 127.17.88.1:0 I0516 22:02:32.335460 17760 webserver.cc:184] Document root disabled I0516 22:02:32.335886 17760 webserver.cc:311] Webserver started. Bound to: http://127.17.88.1:42635/ I0516 22:02:32.339154 17760 system_ntp.cc:143] NTP initialized. Skew: 500ppm Current error: 1236988us I0516 22:02:32.339360 17760 fs_manager.cc:260] Metadata directory not provided I0516 22:02:32.339417 17760 fs_manager.cc:266] Using write-ahead log directory (fs_wal_dir) as metadata directory I0516 22:02:32.339506 17760 server_base.cc:433] Could not load existing FS layout: Not found: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-1-root/instance: No such file or directory (error 2) I0516 22:02:32.339545 17760 server_base.cc:434] Attempting to create new FS layout instead I0516 22:02:32.341786 17760 fs_manager.cc:595] Generated new instance metadata in path /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-1-root/instance: uuid: "d2767dd0c676459aa9c2533260fc9d46" format_stamp: "Formatted at 2018-05-16 22:02:32 on dist-test-slave-dist-test-slave-gwpd" I0516 22:02:32.346663 17760 fs_manager.cc:495] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s I0516 22:02:32.347487 17760 file_cache.cc:470] Constructed file cache lbm with capacity 26214 I0516 22:02:32.349781 17760 fs_manager.cc:417] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0516 22:02:32.349869 17760 fs_manager.cc:428] Opened local filesystem: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-1-root uuid: "d2767dd0c676459aa9c2533260fc9d46" format_stamp: "Formatted at 2018-05-16 22:02:32 on dist-test-slave-dist-test-slave-gwpd" I0516 22:02:32.349953 17760 fs_report.cc:347] Block manager report -------------------- 1 data directories: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0516 22:02:32.351128 18125 heartbeater.cc:346] Connected to a master server at 127.17.88.62:39073 I0516 22:02:32.351238 18125 heartbeater.cc:426] Registering TS with master... I0516 22:02:32.351467 18125 heartbeater.cc:475] Master 127.17.88.62:39073 requested a full tablet report, sending... I0516 22:02:32.352289 18018 ts_manager.cc:81] Registered new tserver with Master: d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.353302 18018 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60782 I0516 22:02:32.360136 17760 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0516 22:02:32.371613 17760 rpc_server.cc:205] RPC server started. Bound to: 127.17.88.2:58101 I0516 22:02:32.371865 17760 webserver.cc:173] Starting webserver on 127.17.88.2:0 I0516 22:02:32.371892 17760 webserver.cc:184] Document root disabled I0516 22:02:32.372349 17760 webserver.cc:311] Webserver started. Bound to: http://127.17.88.2:37170/ I0516 22:02:32.375478 17760 system_ntp.cc:143] NTP initialized. Skew: 500ppm Current error: 1236988us I0516 22:02:32.375664 17760 fs_manager.cc:260] Metadata directory not provided I0516 22:02:32.375711 17760 fs_manager.cc:266] Using write-ahead log directory (fs_wal_dir) as metadata directory I0516 22:02:32.375810 17760 server_base.cc:433] Could not load existing FS layout: Not found: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-2-root/instance: No such file or directory (error 2) I0516 22:02:32.375849 17760 server_base.cc:434] Attempting to create new FS layout instead I0516 22:02:32.377925 17760 fs_manager.cc:595] Generated new instance metadata in path /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-2-root/instance: uuid: "b141e05cb0444865b490089e568edadc" format_stamp: "Formatted at 2018-05-16 22:02:32 on dist-test-slave-dist-test-slave-gwpd" I0516 22:02:32.378324 18193 heartbeater.cc:346] Connected to a master server at 127.17.88.62:39073 I0516 22:02:32.378409 18193 heartbeater.cc:426] Registering TS with master... I0516 22:02:32.378613 18193 heartbeater.cc:475] Master 127.17.88.62:39073 requested a full tablet report, sending... I0516 22:02:32.379227 18018 ts_manager.cc:81] Registered new tserver with Master: d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.379946 18018 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60783 I0516 22:02:32.381381 17760 fs_manager.cc:495] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s I0516 22:02:32.382100 17760 file_cache.cc:470] Constructed file cache lbm with capacity 26214 I0516 22:02:32.384263 17760 fs_manager.cc:417] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0516 22:02:32.384330 17760 fs_manager.cc:428] Opened local filesystem: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-2-root uuid: "b141e05cb0444865b490089e568edadc" format_stamp: "Formatted at 2018-05-16 22:02:32 on dist-test-slave-dist-test-slave-gwpd" I0516 22:02:32.384409 17760 fs_report.cc:347] Block manager report -------------------- 1 data directories: /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0516 22:02:32.406672 17760 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0516 22:02:32.417873 17760 rpc_server.cc:205] RPC server started. Bound to: 127.17.88.3:49899 I0516 22:02:32.418143 17760 webserver.cc:173] Starting webserver on 127.17.88.3:0 I0516 22:02:32.418171 17760 webserver.cc:184] Document root disabled I0516 22:02:32.418628 17760 webserver.cc:311] Webserver started. Bound to: http://127.17.88.3:48392/ I0516 22:02:32.424301 18260 heartbeater.cc:346] Connected to a master server at 127.17.88.62:39073 I0516 22:02:32.424383 18260 heartbeater.cc:426] Registering TS with master... I0516 22:02:32.424579 18260 heartbeater.cc:475] Master 127.17.88.62:39073 requested a full tablet report, sending... I0516 22:02:32.425184 18018 ts_manager.cc:81] Registered new tserver with Master: b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.425648 17760 internal_mini_cluster.cc:326] 3 TS(s) registered with all masters after 0.006524538s I0516 22:02:32.426012 18018 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60784 I0516 22:02:32.439630 17760 test_util.cc:200] Using random seed: -533970121 I0516 22:02:32.448016 18018 catalog_manager.cc:1315] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60787: name: "test-workload" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s" } partition_schema { range_schema { columns { name: "key" } } } W0516 22:02:32.448927 18018 catalog_manager.cc:1463] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a replica failure: 4 tablet servers are needed, 3 are alive. Consider bringing up additional tablet server(s) or running both the masters and all tablet servers with --raft_prepare_replacement_before_eviction=false flag (not recommended). I0516 22:02:32.474361 18227 tablet_service.cc:760] Processing CreateTablet for tablet 50f4658409f4467d91579fefb4bbc4af (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION VALUES < 214748364 I0516 22:02:32.474938 18224 tablet_service.cc:760] Processing CreateTablet for tablet f44edd9cb161433f9ae53e8d2e60e43e (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456 I0516 22:02:32.475553 18227 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 50f4658409f4467d91579fefb4bbc4af. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.477164 18224 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet f44edd9cb161433f9ae53e8d2e60e43e. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.477536 18221 tablet_service.cc:760] Processing CreateTablet for tablet 7966cd4464434af09b1b861e14d66bf9 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548 I0516 22:02:32.477524 18223 tablet_service.cc:760] Processing CreateTablet for tablet fde57a2e13af4bcc9077306cd4109c3e (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820 I0516 22:02:32.478539 18225 tablet_service.cc:760] Processing CreateTablet for tablet ab7b2ac793a4455e9bbe98795c6a392f (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092 I0516 22:02:32.479696 18092 tablet_service.cc:760] Processing CreateTablet for tablet 50f4658409f4467d91579fefb4bbc4af (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION VALUES < 214748364 I0516 22:02:32.480306 18226 tablet_service.cc:760] Processing CreateTablet for tablet f970f063780d4349888d8fd439beb0a0 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728 I0516 22:02:32.480340 18222 tablet_service.cc:760] Processing CreateTablet for tablet d744b1d6ab5c4844bd636ab76a6c3bee (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184 I0516 22:02:32.480511 18221 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 7966cd4464434af09b1b861e14d66bf9. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.480881 18220 tablet_service.cc:760] Processing CreateTablet for tablet f2d85aa48a984f07a36195498f0f3754 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912 I0516 22:02:32.481870 18092 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 50f4658409f4467d91579fefb4bbc4af. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.481873 18223 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet fde57a2e13af4bcc9077306cd4109c3e. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.481961 18089 tablet_service.cc:760] Processing CreateTablet for tablet f44edd9cb161433f9ae53e8d2e60e43e (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456 I0516 22:02:32.482376 18218 tablet_service.cc:760] Processing CreateTablet for tablet 00efb34f943d4fa88ec6dcd181ee5c96 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION VALUES >= 1932735276 I0516 22:02:32.482874 18219 tablet_service.cc:760] Processing CreateTablet for tablet 807b2c351057419d846ab8586e3ed167 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276 I0516 22:02:32.482904 18088 tablet_service.cc:760] Processing CreateTablet for tablet fde57a2e13af4bcc9077306cd4109c3e (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820 I0516 22:02:32.483480 18084 tablet_service.cc:760] Processing CreateTablet for tablet 807b2c351057419d846ab8586e3ed167 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276 I0516 22:02:32.483633 18225 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet ab7b2ac793a4455e9bbe98795c6a392f. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.483757 18086 tablet_service.cc:760] Processing CreateTablet for tablet 7966cd4464434af09b1b861e14d66bf9 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548 I0516 22:02:32.484330 18089 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet f44edd9cb161433f9ae53e8d2e60e43e. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.484278 18087 tablet_service.cc:760] Processing CreateTablet for tablet d744b1d6ab5c4844bd636ab76a6c3bee (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184 I0516 22:02:32.484189 18085 tablet_service.cc:760] Processing CreateTablet for tablet f2d85aa48a984f07a36195498f0f3754 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912 I0516 22:02:32.484611 18091 tablet_service.cc:760] Processing CreateTablet for tablet f970f063780d4349888d8fd439beb0a0 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728 I0516 22:02:32.485374 18226 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet f970f063780d4349888d8fd439beb0a0. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.485443 18083 tablet_service.cc:760] Processing CreateTablet for tablet 00efb34f943d4fa88ec6dcd181ee5c96 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION VALUES >= 1932735276 I0516 22:02:32.486027 18219 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 807b2c351057419d846ab8586e3ed167. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.486057 18090 tablet_service.cc:760] Processing CreateTablet for tablet ab7b2ac793a4455e9bbe98795c6a392f (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092 I0516 22:02:32.486863 18220 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet f2d85aa48a984f07a36195498f0f3754. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.487574 18088 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet fde57a2e13af4bcc9077306cd4109c3e. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.487716 18218 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 00efb34f943d4fa88ec6dcd181ee5c96. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.488261 18084 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 807b2c351057419d846ab8586e3ed167. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.488586 18222 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet d744b1d6ab5c4844bd636ab76a6c3bee. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.490592 18087 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet d744b1d6ab5c4844bd636ab76a6c3bee. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.492027 18091 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet f970f063780d4349888d8fd439beb0a0. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.492357 18090 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet ab7b2ac793a4455e9bbe98795c6a392f. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.492599 18083 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 00efb34f943d4fa88ec6dcd181ee5c96. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.493713 18086 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 7966cd4464434af09b1b861e14d66bf9. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.494418 18085 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet f2d85aa48a984f07a36195498f0f3754. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.509673 18224 ts_tablet_manager.cc:1173] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.513902 18227 ts_tablet_manager.cc:1173] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.524569 18092 ts_tablet_manager.cc:1173] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.525833 18281 ts_tablet_manager.cc:1028] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Bootstrapping tablet I0516 22:02:32.526235 18089 ts_tablet_manager.cc:1173] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.527427 18281 tablet_bootstrap.cc:436] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Bootstrap starting. I0516 22:02:32.529491 18222 ts_tablet_manager.cc:1173] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.535570 18088 ts_tablet_manager.cc:1173] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.536641 18221 ts_tablet_manager.cc:1173] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.561130 18219 ts_tablet_manager.cc:1173] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.562798 18087 ts_tablet_manager.cc:1173] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.563258 18218 ts_tablet_manager.cc:1173] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.563607 18282 ts_tablet_manager.cc:1028] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrapping tablet I0516 22:02:32.565656 18282 tablet_bootstrap.cc:436] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrap starting. I0516 22:02:32.565660 18226 ts_tablet_manager.cc:1173] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.566057 18223 ts_tablet_manager.cc:1173] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.566615 18085 ts_tablet_manager.cc:1173] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.566619 18225 ts_tablet_manager.cc:1173] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.568589 18090 ts_tablet_manager.cc:1173] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.569267 18220 ts_tablet_manager.cc:1173] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.569278 18281 tablet_bootstrap.cc:587] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: No blocks or log segments found. Creating new log. I0516 22:02:32.569587 18159 tablet_service.cc:760] Processing CreateTablet for tablet f970f063780d4349888d8fd439beb0a0 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728 I0516 22:02:32.570564 18084 ts_tablet_manager.cc:1173] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.570631 18160 tablet_service.cc:760] Processing CreateTablet for tablet 50f4658409f4467d91579fefb4bbc4af (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION VALUES < 214748364 I0516 22:02:32.570969 18154 tablet_service.cc:760] Processing CreateTablet for tablet 7966cd4464434af09b1b861e14d66bf9 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548 I0516 22:02:32.571125 18159 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet f970f063780d4349888d8fd439beb0a0. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.571097 18155 tablet_service.cc:760] Processing CreateTablet for tablet d744b1d6ab5c4844bd636ab76a6c3bee (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184 I0516 22:02:32.571983 18157 tablet_service.cc:760] Processing CreateTablet for tablet f44edd9cb161433f9ae53e8d2e60e43e (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456 I0516 22:02:32.572067 18160 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 50f4658409f4467d91579fefb4bbc4af. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.572427 18086 ts_tablet_manager.cc:1173] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.572455 18155 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet d744b1d6ab5c4844bd636ab76a6c3bee. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.572430 18152 tablet_service.cc:760] Processing CreateTablet for tablet 807b2c351057419d846ab8586e3ed167 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276 I0516 22:02:32.572495 18153 tablet_service.cc:760] Processing CreateTablet for tablet f2d85aa48a984f07a36195498f0f3754 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912 I0516 22:02:32.573002 18158 tablet_service.cc:760] Processing CreateTablet for tablet ab7b2ac793a4455e9bbe98795c6a392f (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092 I0516 22:02:32.573266 18091 ts_tablet_manager.cc:1173] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.573292 18151 tablet_service.cc:760] Processing CreateTablet for tablet 00efb34f943d4fa88ec6dcd181ee5c96 (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION VALUES >= 1932735276 I0516 22:02:32.573585 18156 tablet_service.cc:760] Processing CreateTablet for tablet fde57a2e13af4bcc9077306cd4109c3e (table=test-workload [id=b81d5ce0c26147e199605e0eca7fdd50]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820 I0516 22:02:32.574041 18154 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 7966cd4464434af09b1b861e14d66bf9. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.574256 18156 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet fde57a2e13af4bcc9077306cd4109c3e. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.574800 18151 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 00efb34f943d4fa88ec6dcd181ee5c96. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.575135 18158 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet ab7b2ac793a4455e9bbe98795c6a392f. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.575330 18152 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 807b2c351057419d846ab8586e3ed167. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.575678 18153 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet f2d85aa48a984f07a36195498f0f3754. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.576416 18083 ts_tablet_manager.cc:1173] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.577497 18157 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet f44edd9cb161433f9ae53e8d2e60e43e. 1 dirs total, 0 dirs full, 0 dirs failed I0516 22:02:32.584558 18281 tablet_bootstrap.cc:436] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: No bootstrap required, opened a new log I0516 22:02:32.584858 18281 ts_tablet_manager.cc:1045] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Time spent bootstrapping tablet: real 0.058s user 0.000s sys 0.004s I0516 22:02:32.586879 18281 raft_consensus.cc:303] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.588613 18281 raft_consensus.cc:329] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.588917 18281 raft_consensus.cc:604] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b141e05cb0444865b490089e568edadc, State: Initialized, Role: FOLLOWER I0516 22:02:32.589787 18159 ts_tablet_manager.cc:1173] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.590140 18156 ts_tablet_manager.cc:1173] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.593072 18160 ts_tablet_manager.cc:1173] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.594832 18158 ts_tablet_manager.cc:1173] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.595911 18152 ts_tablet_manager.cc:1173] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.595625 18281 consensus_queue.cc:227] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.596405 18153 ts_tablet_manager.cc:1173] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.600500 18282 tablet_bootstrap.cc:587] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: No blocks or log segments found. Creating new log. I0516 22:02:32.600518 18284 ts_tablet_manager.cc:1028] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Bootstrapping tablet I0516 22:02:32.600528 18260 heartbeater.cc:467] Master 127.17.88.62:39073 was elected leader, sending a full tablet report... I0516 22:02:32.600528 18154 ts_tablet_manager.cc:1173] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.600687 18281 ts_tablet_manager.cc:1073] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Time spent starting tablet: real 0.016s user 0.000s sys 0.004s I0516 22:02:32.600809 18151 ts_tablet_manager.cc:1173] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.601109 18281 ts_tablet_manager.cc:1028] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc: Bootstrapping tablet I0516 22:02:32.601112 18157 ts_tablet_manager.cc:1173] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.601137 18284 tablet_bootstrap.cc:436] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Bootstrap starting. I0516 22:02:32.601347 18281 tablet_bootstrap.cc:436] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc: Bootstrap starting. I0516 22:02:32.602759 18155 ts_tablet_manager.cc:1173] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46: Registered tablet (data state: TABLET_DATA_READY) I0516 22:02:32.604444 18281 tablet_bootstrap.cc:587] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc: No blocks or log segments found. Creating new log. I0516 22:02:32.604743 18284 tablet_bootstrap.cc:587] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: No blocks or log segments found. Creating new log. I0516 22:02:32.605608 18282 tablet_bootstrap.cc:436] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: No bootstrap required, opened a new log I0516 22:02:32.605993 18282 ts_tablet_manager.cc:1045] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s I0516 22:02:32.606621 18281 tablet_bootstrap.cc:436] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc: No bootstrap required, opened a new log I0516 22:02:32.606614 18282 raft_consensus.cc:303] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:32.606765 18281 ts_tablet_manager.cc:1045] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s I0516 22:02:32.606829 18282 raft_consensus.cc:329] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.606869 18282 raft_consensus.cc:604] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Initialized, Role: FOLLOWER I0516 22:02:32.607018 18282 consensus_queue.cc:227] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:32.607322 18281 raft_consensus.cc:303] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:32.607465 18281 raft_consensus.cc:329] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.607501 18281 raft_consensus.cc:604] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b141e05cb0444865b490089e568edadc, State: Initialized, Role: FOLLOWER I0516 22:02:32.607591 18284 tablet_bootstrap.cc:436] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: No bootstrap required, opened a new log I0516 22:02:32.607697 18284 ts_tablet_manager.cc:1045] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s I0516 22:02:32.607664 18281 consensus_queue.cc:227] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:32.608160 18284 raft_consensus.cc:303] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.608372 18284 raft_consensus.cc:329] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.608420 18284 raft_consensus.cc:604] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Initialized, Role: FOLLOWER I0516 22:02:32.608582 18284 consensus_queue.cc:227] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.609998 18281 ts_tablet_manager.cc:1073] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s I0516 22:02:32.610098 18281 ts_tablet_manager.cc:1028] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc: Bootstrapping tablet I0516 22:02:32.610182 18281 tablet_bootstrap.cc:436] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc: Bootstrap starting. I0516 22:02:32.611047 18281 tablet_bootstrap.cc:587] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc: No blocks or log segments found. Creating new log. I0516 22:02:32.614908 18125 heartbeater.cc:467] Master 127.17.88.62:39073 was elected leader, sending a full tablet report... I0516 22:02:32.615113 18282 ts_tablet_manager.cc:1073] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Time spent starting tablet: real 0.009s user 0.004s sys 0.008s I0516 22:02:32.615375 18193 heartbeater.cc:467] Master 127.17.88.62:39073 was elected leader, sending a full tablet report... I0516 22:02:32.615586 18281 tablet_bootstrap.cc:436] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc: No bootstrap required, opened a new log I0516 22:02:32.615767 18282 ts_tablet_manager.cc:1028] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrapping tablet I0516 22:02:32.615783 18284 ts_tablet_manager.cc:1073] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s I0516 22:02:32.615939 18282 tablet_bootstrap.cc:436] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrap starting. I0516 22:02:32.616363 18281 ts_tablet_manager.cc:1045] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc: Time spent bootstrapping tablet: real 0.006s user 0.008s sys 0.000s I0516 22:02:32.616788 18281 raft_consensus.cc:303] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.616922 18284 ts_tablet_manager.cc:1028] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46: Bootstrapping tablet I0516 22:02:32.616997 18284 tablet_bootstrap.cc:436] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46: Bootstrap starting. I0516 22:02:32.617353 18281 raft_consensus.cc:329] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.617411 18281 raft_consensus.cc:604] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b141e05cb0444865b490089e568edadc, State: Initialized, Role: FOLLOWER I0516 22:02:32.617782 18281 consensus_queue.cc:227] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.619140 18284 tablet_bootstrap.cc:587] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46: No blocks or log segments found. Creating new log. I0516 22:02:32.619448 18281 ts_tablet_manager.cc:1073] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s I0516 22:02:32.619552 18281 ts_tablet_manager.cc:1028] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Bootstrapping tablet I0516 22:02:32.619627 18281 tablet_bootstrap.cc:436] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Bootstrap starting. I0516 22:02:32.620358 18282 tablet_bootstrap.cc:587] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: No blocks or log segments found. Creating new log. I0516 22:02:32.620694 18281 tablet_bootstrap.cc:587] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: No blocks or log segments found. Creating new log. I0516 22:02:32.621377 18284 tablet_bootstrap.cc:436] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46: No bootstrap required, opened a new log I0516 22:02:32.621476 18284 ts_tablet_manager.cc:1045] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.004s I0516 22:02:32.621785 18282 tablet_bootstrap.cc:436] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: No bootstrap required, opened a new log I0516 22:02:32.621902 18282 ts_tablet_manager.cc:1045] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.000s I0516 22:02:32.621852 18284 raft_consensus.cc:303] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.621994 18284 raft_consensus.cc:329] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.622030 18284 raft_consensus.cc:604] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Initialized, Role: FOLLOWER I0516 22:02:32.622176 18284 consensus_queue.cc:227] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.622385 18282 raft_consensus.cc:303] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.622537 18282 raft_consensus.cc:329] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.622583 18282 raft_consensus.cc:604] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Initialized, Role: FOLLOWER I0516 22:02:32.622814 18284 ts_tablet_manager.cc:1073] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0516 22:02:32.622762 18282 consensus_queue.cc:227] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.622916 18284 ts_tablet_manager.cc:1028] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Bootstrapping tablet I0516 22:02:32.623006 18284 tablet_bootstrap.cc:436] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Bootstrap starting. W0516 22:02:32.623407 18194 tablet.cc:1678] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Can't schedule compaction. Clean time has not been advanced past its initial value. I0516 22:02:32.624053 18284 tablet_bootstrap.cc:587] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: No blocks or log segments found. Creating new log. I0516 22:02:32.624594 18282 ts_tablet_manager.cc:1073] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s I0516 22:02:32.624723 18282 ts_tablet_manager.cc:1028] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrapping tablet I0516 22:02:32.624825 18282 tablet_bootstrap.cc:436] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrap starting. I0516 22:02:32.625603 18284 tablet_bootstrap.cc:436] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: No bootstrap required, opened a new log I0516 22:02:32.625687 18281 tablet_bootstrap.cc:436] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: No bootstrap required, opened a new log I0516 22:02:32.625697 18284 ts_tablet_manager.cc:1045] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Time spent bootstrapping tablet: real 0.003s user 0.004s sys 0.000s I0516 22:02:32.625803 18281 ts_tablet_manager.cc:1045] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s I0516 22:02:32.625916 18282 tablet_bootstrap.cc:587] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: No blocks or log segments found. Creating new log. I0516 22:02:32.626139 18284 raft_consensus.cc:303] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:32.626299 18284 raft_consensus.cc:329] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.626340 18284 raft_consensus.cc:604] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Initialized, Role: FOLLOWER I0516 22:02:32.626205 18281 raft_consensus.cc:303] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.626420 18281 raft_consensus.cc:329] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.626464 18281 raft_consensus.cc:604] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b141e05cb0444865b490089e568edadc, State: Initialized, Role: FOLLOWER I0516 22:02:32.626499 18284 consensus_queue.cc:227] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:32.626623 18281 consensus_queue.cc:227] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.627082 18281 ts_tablet_manager.cc:1073] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0516 22:02:32.627187 18281 ts_tablet_manager.cc:1028] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc: Bootstrapping tablet I0516 22:02:32.627300 18284 ts_tablet_manager.cc:1073] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s I0516 22:02:32.627357 18281 tablet_bootstrap.cc:436] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc: Bootstrap starting. I0516 22:02:32.627425 18284 ts_tablet_manager.cc:1028] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46: Bootstrapping tablet I0516 22:02:32.627512 18284 tablet_bootstrap.cc:436] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46: Bootstrap starting. I0516 22:02:32.628228 18281 tablet_bootstrap.cc:587] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc: No blocks or log segments found. Creating new log. I0516 22:02:32.628382 18284 tablet_bootstrap.cc:587] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46: No blocks or log segments found. Creating new log. I0516 22:02:32.629848 18282 tablet_bootstrap.cc:436] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: No bootstrap required, opened a new log I0516 22:02:32.630018 18282 ts_tablet_manager.cc:1045] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s I0516 22:02:32.630028 18281 tablet_bootstrap.cc:436] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc: No bootstrap required, opened a new log I0516 22:02:32.630169 18281 ts_tablet_manager.cc:1045] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc: Time spent bootstrapping tablet: real 0.003s user 0.004s sys 0.000s I0516 22:02:32.630515 18282 raft_consensus.cc:303] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.630671 18282 raft_consensus.cc:329] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.630717 18282 raft_consensus.cc:604] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Initialized, Role: FOLLOWER I0516 22:02:32.630776 18284 tablet_bootstrap.cc:436] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46: No bootstrap required, opened a new log I0516 22:02:32.630596 18281 raft_consensus.cc:303] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.630923 18284 ts_tablet_manager.cc:1045] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.004s I0516 22:02:32.630956 18281 raft_consensus.cc:329] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.630995 18281 raft_consensus.cc:604] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b141e05cb0444865b490089e568edadc, State: Initialized, Role: FOLLOWER I0516 22:02:32.630914 18282 consensus_queue.cc:227] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.631136 18281 consensus_queue.cc:227] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.631434 18284 raft_consensus.cc:303] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.631633 18284 raft_consensus.cc:329] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.631641 18281 ts_tablet_manager.cc:1073] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0516 22:02:32.631678 18282 ts_tablet_manager.cc:1073] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s I0516 22:02:32.631678 18284 raft_consensus.cc:604] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Initialized, Role: FOLLOWER I0516 22:02:32.631755 18281 ts_tablet_manager.cc:1028] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc: Bootstrapping tablet I0516 22:02:32.631790 18282 ts_tablet_manager.cc:1028] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrapping tablet I0516 22:02:32.631844 18281 tablet_bootstrap.cc:436] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc: Bootstrap starting. I0516 22:02:32.631896 18282 tablet_bootstrap.cc:436] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrap starting. I0516 22:02:32.631877 18284 consensus_queue.cc:227] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.632488 18284 ts_tablet_manager.cc:1073] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s I0516 22:02:32.633540 18284 ts_tablet_manager.cc:1028] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46: Bootstrapping tablet I0516 22:02:32.633678 18282 tablet_bootstrap.cc:587] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: No blocks or log segments found. Creating new log. I0516 22:02:32.633718 18284 tablet_bootstrap.cc:436] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46: Bootstrap starting. I0516 22:02:32.634034 18281 tablet_bootstrap.cc:587] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc: No blocks or log segments found. Creating new log. I0516 22:02:32.635323 18284 tablet_bootstrap.cc:587] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46: No blocks or log segments found. Creating new log. I0516 22:02:32.635618 18282 tablet_bootstrap.cc:436] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: No bootstrap required, opened a new log I0516 22:02:32.635733 18282 ts_tablet_manager.cc:1045] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.004s I0516 22:02:32.636026 18281 tablet_bootstrap.cc:436] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc: No bootstrap required, opened a new log I0516 22:02:32.636147 18281 ts_tablet_manager.cc:1045] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s I0516 22:02:32.636291 18282 raft_consensus.cc:303] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.636463 18282 raft_consensus.cc:329] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.636504 18282 raft_consensus.cc:604] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Initialized, Role: FOLLOWER I0516 22:02:32.636646 18282 consensus_queue.cc:227] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.636728 18284 tablet_bootstrap.cc:436] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46: No bootstrap required, opened a new log I0516 22:02:32.636688 18281 raft_consensus.cc:303] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.636879 18284 ts_tablet_manager.cc:1045] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46: Time spent bootstrapping tablet: real 0.003s user 0.004s sys 0.000s I0516 22:02:32.636895 18281 raft_consensus.cc:329] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.636929 18281 raft_consensus.cc:604] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b141e05cb0444865b490089e568edadc, State: Initialized, Role: FOLLOWER I0516 22:02:32.637076 18281 consensus_queue.cc:227] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.637272 18284 raft_consensus.cc:303] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.637431 18284 raft_consensus.cc:329] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.637467 18284 raft_consensus.cc:604] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Initialized, Role: FOLLOWER I0516 22:02:32.637645 18281 ts_tablet_manager.cc:1073] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0516 22:02:32.637619 18284 consensus_queue.cc:227] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.637744 18281 ts_tablet_manager.cc:1028] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc: Bootstrapping tablet I0516 22:02:32.637825 18281 tablet_bootstrap.cc:436] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc: Bootstrap starting. I0516 22:02:32.638417 18284 ts_tablet_manager.cc:1073] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0516 22:02:32.638425 18282 ts_tablet_manager.cc:1073] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s I0516 22:02:32.638617 18282 ts_tablet_manager.cc:1028] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrapping tablet I0516 22:02:32.638712 18282 tablet_bootstrap.cc:436] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrap starting. I0516 22:02:32.639109 18284 ts_tablet_manager.cc:1028] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46: Bootstrapping tablet I0516 22:02:32.639230 18284 tablet_bootstrap.cc:436] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46: Bootstrap starting. I0516 22:02:32.640553 18284 tablet_bootstrap.cc:587] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46: No blocks or log segments found. Creating new log. I0516 22:02:32.640617 18281 tablet_bootstrap.cc:587] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc: No blocks or log segments found. Creating new log. I0516 22:02:32.640826 18282 tablet_bootstrap.cc:587] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: No blocks or log segments found. Creating new log. I0516 22:02:32.641993 18284 tablet_bootstrap.cc:436] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46: No bootstrap required, opened a new log I0516 22:02:32.642094 18284 ts_tablet_manager.cc:1045] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s I0516 22:02:32.642340 18281 tablet_bootstrap.cc:436] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc: No bootstrap required, opened a new log I0516 22:02:32.642447 18281 ts_tablet_manager.cc:1045] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s I0516 22:02:32.642493 18284 raft_consensus.cc:303] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.642652 18284 raft_consensus.cc:329] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.642701 18284 raft_consensus.cc:604] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Initialized, Role: FOLLOWER I0516 22:02:32.642823 18284 consensus_queue.cc:227] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.642922 18281 raft_consensus.cc:303] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.643050 18281 raft_consensus.cc:329] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.643085 18281 raft_consensus.cc:604] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b141e05cb0444865b490089e568edadc, State: Initialized, Role: FOLLOWER I0516 22:02:32.643215 18281 consensus_queue.cc:227] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.643422 18284 ts_tablet_manager.cc:1073] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46: Time spent starting tablet: real 0.001s user 0.000s sys 0.004s I0516 22:02:32.643534 18284 ts_tablet_manager.cc:1028] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46: Bootstrapping tablet I0516 22:02:32.643627 18284 tablet_bootstrap.cc:436] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46: Bootstrap starting. I0516 22:02:32.644434 18284 tablet_bootstrap.cc:587] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46: No blocks or log segments found. Creating new log. I0516 22:02:32.643541 18281 ts_tablet_manager.cc:1073] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0516 22:02:32.645081 18281 ts_tablet_manager.cc:1028] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc: Bootstrapping tablet I0516 22:02:32.645217 18281 tablet_bootstrap.cc:436] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc: Bootstrap starting. I0516 22:02:32.645668 18282 tablet_bootstrap.cc:436] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: No bootstrap required, opened a new log I0516 22:02:32.645716 18284 tablet_bootstrap.cc:436] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46: No bootstrap required, opened a new log I0516 22:02:32.645761 18282 ts_tablet_manager.cc:1045] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s I0516 22:02:32.645817 18284 ts_tablet_manager.cc:1045] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s I0516 22:02:32.646073 18281 tablet_bootstrap.cc:587] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc: No blocks or log segments found. Creating new log. I0516 22:02:32.646209 18282 raft_consensus.cc:303] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.646325 18284 raft_consensus.cc:303] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.646888 18282 raft_consensus.cc:329] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.646898 18284 raft_consensus.cc:329] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.646982 18284 raft_consensus.cc:604] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Initialized, Role: FOLLOWER I0516 22:02:32.647001 18282 raft_consensus.cc:604] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Initialized, Role: FOLLOWER I0516 22:02:32.647168 18284 consensus_queue.cc:227] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.647397 18281 tablet_bootstrap.cc:436] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc: No bootstrap required, opened a new log I0516 22:02:32.647485 18281 ts_tablet_manager.cc:1045] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.004s I0516 22:02:32.647541 18284 ts_tablet_manager.cc:1073] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s I0516 22:02:32.647649 18284 ts_tablet_manager.cc:1028] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Bootstrapping tablet I0516 22:02:32.647739 18284 tablet_bootstrap.cc:436] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Bootstrap starting. I0516 22:02:32.647846 18281 raft_consensus.cc:303] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.647981 18281 raft_consensus.cc:329] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.648015 18281 raft_consensus.cc:604] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b141e05cb0444865b490089e568edadc, State: Initialized, Role: FOLLOWER I0516 22:02:32.648155 18281 consensus_queue.cc:227] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.648422 18282 consensus_queue.cc:227] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.648576 18284 tablet_bootstrap.cc:587] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: No blocks or log segments found. Creating new log. I0516 22:02:32.649444 18282 ts_tablet_manager.cc:1073] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s I0516 22:02:32.649556 18282 ts_tablet_manager.cc:1028] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrapping tablet I0516 22:02:32.649642 18282 tablet_bootstrap.cc:436] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrap starting. I0516 22:02:32.650441 18282 tablet_bootstrap.cc:587] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: No blocks or log segments found. Creating new log. I0516 22:02:32.651340 18281 ts_tablet_manager.cc:1073] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s I0516 22:02:32.651454 18281 ts_tablet_manager.cc:1028] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc: Bootstrapping tablet I0516 22:02:32.651538 18281 tablet_bootstrap.cc:436] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc: Bootstrap starting. I0516 22:02:32.651718 18282 tablet_bootstrap.cc:436] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: No bootstrap required, opened a new log I0516 22:02:32.651870 18282 ts_tablet_manager.cc:1045] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.004s I0516 22:02:32.652438 18281 tablet_bootstrap.cc:587] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc: No blocks or log segments found. Creating new log. I0516 22:02:32.652382 18282 raft_consensus.cc:303] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.652531 18282 raft_consensus.cc:329] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.652590 18282 raft_consensus.cc:604] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Initialized, Role: FOLLOWER I0516 22:02:32.652792 18282 consensus_queue.cc:227] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.653331 18284 tablet_bootstrap.cc:436] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: No bootstrap required, opened a new log I0516 22:02:32.653442 18284 ts_tablet_manager.cc:1045] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s I0516 22:02:32.653554 18282 ts_tablet_manager.cc:1073] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s I0516 22:02:32.653663 18282 ts_tablet_manager.cc:1028] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrapping tablet I0516 22:02:32.653775 18282 tablet_bootstrap.cc:436] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrap starting. I0516 22:02:32.653795 18281 tablet_bootstrap.cc:436] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc: No bootstrap required, opened a new log I0516 22:02:32.653900 18281 ts_tablet_manager.cc:1045] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc: Time spent bootstrapping tablet: real 0.002s user 0.004s sys 0.000s I0516 22:02:32.654242 18281 raft_consensus.cc:303] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.654737 18281 raft_consensus.cc:329] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.654790 18281 raft_consensus.cc:604] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b141e05cb0444865b490089e568edadc, State: Initialized, Role: FOLLOWER I0516 22:02:32.654796 18282 tablet_bootstrap.cc:587] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: No blocks or log segments found. Creating new log. I0516 22:02:32.654908 18281 consensus_queue.cc:227] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.655269 18281 ts_tablet_manager.cc:1073] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0516 22:02:32.655365 18281 ts_tablet_manager.cc:1028] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Bootstrapping tablet I0516 22:02:32.655441 18281 tablet_bootstrap.cc:436] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Bootstrap starting. I0516 22:02:32.656229 18281 tablet_bootstrap.cc:587] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: No blocks or log segments found. Creating new log. I0516 22:02:32.656914 18284 raft_consensus.cc:303] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.657083 18284 raft_consensus.cc:329] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.657119 18284 raft_consensus.cc:604] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Initialized, Role: FOLLOWER I0516 22:02:32.657263 18284 consensus_queue.cc:227] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.657500 18281 tablet_bootstrap.cc:436] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: No bootstrap required, opened a new log I0516 22:02:32.657603 18281 ts_tablet_manager.cc:1045] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s I0516 22:02:32.657908 18284 ts_tablet_manager.cc:1073] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s I0516 22:02:32.658017 18284 ts_tablet_manager.cc:1028] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46: Bootstrapping tablet I0516 22:02:32.658133 18284 tablet_bootstrap.cc:436] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46: Bootstrap starting. I0516 22:02:32.658089 18281 raft_consensus.cc:303] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.658296 18281 raft_consensus.cc:329] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.658346 18281 raft_consensus.cc:604] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b141e05cb0444865b490089e568edadc, State: Initialized, Role: FOLLOWER I0516 22:02:32.658506 18281 consensus_queue.cc:227] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.659319 18284 tablet_bootstrap.cc:587] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46: No blocks or log segments found. Creating new log. I0516 22:02:32.659790 18281 ts_tablet_manager.cc:1073] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s I0516 22:02:32.660506 18282 tablet_bootstrap.cc:436] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: No bootstrap required, opened a new log I0516 22:02:32.660609 18282 ts_tablet_manager.cc:1045] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.008s I0516 22:02:32.660925 18284 tablet_bootstrap.cc:436] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46: No bootstrap required, opened a new log I0516 22:02:32.661026 18284 ts_tablet_manager.cc:1045] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.004s I0516 22:02:32.661038 18282 raft_consensus.cc:303] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.661190 18282 raft_consensus.cc:329] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.661226 18282 raft_consensus.cc:604] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Initialized, Role: FOLLOWER I0516 22:02:32.661335 18282 consensus_queue.cc:227] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.661409 18284 raft_consensus.cc:303] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.661556 18284 raft_consensus.cc:329] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.661587 18284 raft_consensus.cc:604] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Initialized, Role: FOLLOWER I0516 22:02:32.661749 18282 ts_tablet_manager.cc:1073] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0516 22:02:32.661703 18284 consensus_queue.cc:227] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.661854 18282 ts_tablet_manager.cc:1028] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrapping tablet I0516 22:02:32.661949 18282 tablet_bootstrap.cc:436] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrap starting. I0516 22:02:32.662125 18284 ts_tablet_manager.cc:1073] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0516 22:02:32.662237 18284 ts_tablet_manager.cc:1028] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46: Bootstrapping tablet I0516 22:02:32.662328 18284 tablet_bootstrap.cc:436] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46: Bootstrap starting. I0516 22:02:32.662868 18282 tablet_bootstrap.cc:587] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: No blocks or log segments found. Creating new log. I0516 22:02:32.663297 18284 tablet_bootstrap.cc:587] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46: No blocks or log segments found. Creating new log. I0516 22:02:32.664366 18282 tablet_bootstrap.cc:436] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: No bootstrap required, opened a new log I0516 22:02:32.664470 18282 ts_tablet_manager.cc:1045] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s I0516 22:02:32.664688 18284 tablet_bootstrap.cc:436] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46: No bootstrap required, opened a new log I0516 22:02:32.664783 18284 ts_tablet_manager.cc:1045] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.004s I0516 22:02:32.664891 18282 raft_consensus.cc:303] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.665047 18282 raft_consensus.cc:329] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.665083 18282 raft_consensus.cc:604] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Initialized, Role: FOLLOWER I0516 22:02:32.665194 18282 consensus_queue.cc:227] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.665228 18284 raft_consensus.cc:303] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.665347 18284 raft_consensus.cc:329] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.665383 18284 raft_consensus.cc:604] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Initialized, Role: FOLLOWER I0516 22:02:32.665508 18284 consensus_queue.cc:227] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.665904 18282 ts_tablet_manager.cc:1073] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Time spent starting tablet: real 0.001s user 0.000s sys 0.004s I0516 22:02:32.666009 18282 ts_tablet_manager.cc:1028] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrapping tablet I0516 22:02:32.666118 18282 tablet_bootstrap.cc:436] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrap starting. I0516 22:02:32.666568 18284 ts_tablet_manager.cc:1073] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s I0516 22:02:32.667014 18282 tablet_bootstrap.cc:587] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: No blocks or log segments found. Creating new log. I0516 22:02:32.668113 18282 tablet_bootstrap.cc:436] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: No bootstrap required, opened a new log I0516 22:02:32.668200 18282 ts_tablet_manager.cc:1045] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s I0516 22:02:32.668530 18282 raft_consensus.cc:303] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.668663 18282 raft_consensus.cc:329] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.668695 18282 raft_consensus.cc:604] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Initialized, Role: FOLLOWER I0516 22:02:32.668807 18282 consensus_queue.cc:227] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.669121 18282 ts_tablet_manager.cc:1073] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0516 22:02:32.669216 18282 ts_tablet_manager.cc:1028] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrapping tablet I0516 22:02:32.669299 18282 tablet_bootstrap.cc:436] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Bootstrap starting. I0516 22:02:32.670106 18282 tablet_bootstrap.cc:587] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: No blocks or log segments found. Creating new log. I0516 22:02:32.670836 18290 raft_consensus.cc:435] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0516 22:02:32.670920 18290 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.875s (starting election) I0516 22:02:32.671008 18290 raft_consensus.cc:457] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.671291 18282 tablet_bootstrap.cc:436] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: No bootstrap required, opened a new log I0516 22:02:32.671385 18282 ts_tablet_manager.cc:1045] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.004s I0516 22:02:32.671701 18290 leader_election.cc:243] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.671793 18282 raft_consensus.cc:303] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.672108 18282 raft_consensus.cc:329] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0516 22:02:32.672129 18290 leader_election.cc:243] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.672163 18282 raft_consensus.cc:604] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Initialized, Role: FOLLOWER I0516 22:02:32.672793 18282 consensus_queue.cc:227] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.673223 18282 ts_tablet_manager.cc:1073] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s I0516 22:02:32.674784 18289 raft_consensus.cc:435] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0516 22:02:32.674872 18289 raft_consensus.cc:2704] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.912s (starting election) I0516 22:02:32.674948 18289 raft_consensus.cc:457] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.675283 18289 leader_election.cc:243] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.675474 18289 leader_election.cc:243] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.678704 18102 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" is_pre_election: true I0516 22:02:32.679061 18102 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.188s (vote granted) I0516 22:02:32.679158 18102 raft_consensus.cc:2219] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2767dd0c676459aa9c2533260fc9d46 in term 0. I0516 22:02:32.679776 18133 leader_election.cc:379] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Vote granted by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.679862 18133 leader_election.cc:270] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. I0516 22:02:32.680038 18290 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.546s (election complete) I0516 22:02:32.680128 18290 raft_consensus.cc:2511] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0516 22:02:32.680357 18290 raft_consensus.cc:435] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0516 22:02:32.680487 18290 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.921s (starting election) I0516 22:02:32.680547 18290 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.680812 18170 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" is_pre_election: true I0516 22:02:32.681259 18170 raft_consensus.cc:2704] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.632s (vote granted) I0516 22:02:32.681485 18285 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0516 22:02:32.681494 18170 raft_consensus.cc:2219] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 0. I0516 22:02:32.681773 18285 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.863s (starting election) I0516 22:02:32.681926 18285 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.682270 18063 leader_election.cc:379] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.682284 18285 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.682518 18063 leader_election.cc:270] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. I0516 22:02:32.682813 18285 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.683344 18289 raft_consensus.cc:2704] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.516s (election complete) I0516 22:02:32.683796 18289 raft_consensus.cc:2511] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Leader pre-election won for term 1 I0516 22:02:32.683854 18289 raft_consensus.cc:435] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0516 22:02:32.683902 18289 raft_consensus.cc:2704] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.675s (starting election) I0516 22:02:32.683941 18289 raft_consensus.cc:2756] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.684155 18290 raft_consensus.cc:457] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.684535 18290 leader_election.cc:243] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Requesting vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.684931 18290 leader_election.cc:243] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.685084 18285 raft_consensus.cc:435] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0516 22:02:32.685288 18285 raft_consensus.cc:2704] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.128s (starting election) I0516 22:02:32.685398 18102 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" I0516 22:02:32.686103 18285 raft_consensus.cc:457] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.686918 18102 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.687011 18102 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.735s (vote granted) I0516 22:02:32.687366 18321 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0516 22:02:32.687460 18321 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.842s (starting election) I0516 22:02:32.687716 18289 raft_consensus.cc:457] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.688010 18289 leader_election.cc:243] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.688249 18289 leader_election.cc:243] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.688625 18285 leader_election.cc:243] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.688629 18170 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:32.688760 18285 leader_election.cc:243] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.689263 18170 raft_consensus.cc:2756] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.689616 18170 raft_consensus.cc:2704] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.032s (vote granted) I0516 22:02:32.690865 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" is_pre_election: true I0516 22:02:32.691473 18237 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.060s (vote granted) I0516 22:02:32.691150 18102 raft_consensus.cc:2219] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2767dd0c676459aa9c2533260fc9d46 in term 1. I0516 22:02:32.689690 18321 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:32.690946 18168 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" candidate_uuid: "b141e05cb0444865b490089e568edadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" is_pre_election: true I0516 22:02:32.692304 18133 leader_election.cc:379] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Vote granted by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.691296 18236 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:32.691046 18169 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "b141e05cb0444865b490089e568edadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" is_pre_election: true I0516 22:02:32.691689 18237 raft_consensus.cc:2219] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2767dd0c676459aa9c2533260fc9d46 in term 0. I0516 22:02:32.692664 18169 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.813s (vote granted) I0516 22:02:32.692589 18133 leader_election.cc:270] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0516 22:02:32.692669 18321 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.692786 18169 raft_consensus.cc:2219] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b141e05cb0444865b490089e568edadc in term 0. I0516 22:02:32.692915 18236 raft_consensus.cc:2194] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Leader election vote request: Denying vote to candidate d2767dd0c676459aa9c2533260fc9d46 for term 1 because replica is already servicing an update from a current leader or another vote. I0516 22:02:32.692924 18290 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.943s (election complete) I0516 22:02:32.693508 18290 raft_consensus.cc:2511] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Leader election won for term 1 I0516 22:02:32.693524 18198 leader_election.cc:379] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.693575 18198 leader_election.cc:270] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. I0516 22:02:32.693907 18134 leader_election.cc:379] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.694074 18285 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.113s (election complete) I0516 22:02:32.694128 18285 raft_consensus.cc:2511] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Leader pre-election won for term 1 I0516 22:02:32.699955 18285 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0516 22:02:32.700006 18285 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.157s (starting election) I0516 22:02:32.700188 18285 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.700353 18134 leader_election.cc:393] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Leader election vote request: Denying vote to candidate d2767dd0c676459aa9c2533260fc9d46 for term 1 because replica is already servicing an update from a current leader or another vote. I0516 22:02:32.701311 18321 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.701349 18170 raft_consensus.cc:2219] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 1. I0516 22:02:32.701908 18290 raft_consensus.cc:571] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 1 LEADER]: Becoming Leader. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Running, Role: LEADER I0516 22:02:32.701946 18168 raft_consensus.cc:2194] T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b141e05cb0444865b490089e568edadc for term 1 because replica is already servicing an update from a current leader or another vote. I0516 22:02:32.701973 18063 leader_election.cc:379] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.701915 18170 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "b141e05cb0444865b490089e568edadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" is_pre_election: true I0516 22:02:32.702030 18063 leader_election.cc:270] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0516 22:02:32.702266 18170 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.240s (vote granted) I0516 22:02:32.702324 18170 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b141e05cb0444865b490089e568edadc in term 0. I0516 22:02:32.702615 18198 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.702668 18198 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. I0516 22:02:32.702730 18289 raft_consensus.cc:2704] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.690s (election complete) I0516 22:02:32.703040 18289 raft_consensus.cc:2511] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Leader election won for term 1 I0516 22:02:32.703538 18198 leader_election.cc:393] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T 807b2c351057419d846ab8586e3ed167 P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b141e05cb0444865b490089e568edadc for term 1 because replica is already servicing an update from a current leader or another vote. I0516 22:02:32.707190 18321 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.893s (election complete) I0516 22:02:32.707482 18321 raft_consensus.cc:2511] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Leader pre-election won for term 1 I0516 22:02:32.703624 18285 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.707895 18285 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.708207 18285 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Requesting vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.708537 18321 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0516 22:02:32.706264 18290 consensus_queue.cc:204] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.708972 18321 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.811s (starting election) I0516 22:02:32.708948 18168 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "b141e05cb0444865b490089e568edadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:32.709074 18168 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.709219 18168 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.801s (vote granted) I0516 22:02:32.709218 18321 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.709313 18289 raft_consensus.cc:571] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Becoming Leader. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Running, Role: LEADER I0516 22:02:32.710410 18289 consensus_queue.cc:204] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.711545 18168 raft_consensus.cc:2219] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b141e05cb0444865b490089e568edadc in term 1. I0516 22:02:32.711879 18198 leader_election.cc:379] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.712431 18198 leader_election.cc:270] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0516 22:02:32.712823 18285 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.747s (election complete) I0516 22:02:32.713038 18285 raft_consensus.cc:2511] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Leader election won for term 1 I0516 22:02:32.719333 18018 catalog_manager.cc:3686] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 reported cstate change: term changed from 0 to 1, leader changed from to d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2). New cstate: current_term: 1 leader_uuid: "d2767dd0c676459aa9c2533260fc9d46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } health_report { overall_health: UNKNOWN } } } I0516 22:02:32.725047 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:32.725497 18237 raft_consensus.cc:2756] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.725476 18236 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" is_pre_election: true I0516 22:02:32.723620 18323 raft_consensus.cc:435] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0516 22:02:32.726133 18237 raft_consensus.cc:2704] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.540s (vote granted) I0516 22:02:32.726227 18323 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.778s (starting election) I0516 22:02:32.726682 18102 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "b141e05cb0444865b490089e568edadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" is_pre_election: true I0516 22:02:32.725796 18018 catalog_manager.cc:3686] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a reported cstate change: term changed from 0 to 1, leader changed from to d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1). New cstate: current_term: 1 leader_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } health_report { overall_health: UNKNOWN } } } I0516 22:02:32.727419 18102 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.242s (vote granted) I0516 22:02:32.726081 18285 raft_consensus.cc:571] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 1 LEADER]: Becoming Leader. State: Replica: b141e05cb0444865b490089e568edadc, State: Running, Role: LEADER I0516 22:02:32.728857 18102 raft_consensus.cc:2219] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b141e05cb0444865b490089e568edadc in term 0. I0516 22:02:32.729398 18290 raft_consensus.cc:435] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0516 22:02:32.727246 18100 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "b141e05cb0444865b490089e568edadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" is_pre_election: true I0516 22:02:32.730852 18100 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.631s (vote granted) I0516 22:02:32.730870 18290 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.168s (starting election) I0516 22:02:32.730844 18321 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:32.727726 18101 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" candidate_uuid: "b141e05cb0444865b490089e568edadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" is_pre_election: true I0516 22:02:32.728796 18099 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "b141e05cb0444865b490089e568edadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" I0516 22:02:32.731263 18101 raft_consensus.cc:2180] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate b141e05cb0444865b490089e568edadc for term 1 because replica is either leader or believes a valid leader to be alive. I0516 22:02:32.731185 18290 raft_consensus.cc:457] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.731191 18099 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.731520 18200 leader_election.cc:379] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Vote granted by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.731545 18290 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.727759 18323 raft_consensus.cc:457] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.731704 18099 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.045s (vote granted) I0516 22:02:32.731791 18321 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Requesting vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.730532 18285 consensus_queue.cc:204] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.731956 18290 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.731204 18100 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b141e05cb0444865b490089e568edadc in term 0. I0516 22:02:32.732219 18200 leader_election.cc:393] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Vote denied by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831). Message: Invalid argument: T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate b141e05cb0444865b490089e568edadc for term 1 because replica is either leader or believes a valid leader to be alive. I0516 22:02:32.732379 18237 raft_consensus.cc:2219] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 1. I0516 22:02:32.732741 18101 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" is_pre_election: true I0516 22:02:32.732625 18323 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.733005 18236 raft_consensus.cc:2194] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 1 because replica is already servicing an update from a current leader or another vote. I0516 22:02:32.733023 18200 leader_election.cc:270] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. I0516 22:02:32.733523 18321 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.733502 18101 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.172s (vote granted) I0516 22:02:32.734357 18200 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Vote granted by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.734551 18066 leader_election.cc:379] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.734539 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" is_pre_election: true I0516 22:02:32.734578 18100 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "b141e05cb0444865b490089e568edadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" I0516 22:02:32.734781 18066 leader_election.cc:393] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 1 because replica is already servicing an update from a current leader or another vote. I0516 22:02:32.735268 18326 raft_consensus.cc:2704] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.847s (election complete) I0516 22:02:32.735291 18168 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" is_pre_election: true I0516 22:02:32.735487 18326 raft_consensus.cc:2459] T 807b2c351057419d846ab8586e3ed167 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0516 22:02:32.735503 18170 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "b141e05cb0444865b490089e568edadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:32.735616 18170 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.735708 18101 raft_consensus.cc:2219] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2767dd0c676459aa9c2533260fc9d46 in term 0. I0516 22:02:32.735775 18168 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.172s (vote granted) I0516 22:02:32.735800 18237 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.035s (vote granted) I0516 22:02:32.735935 18237 raft_consensus.cc:2219] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2767dd0c676459aa9c2533260fc9d46 in term 0. I0516 22:02:32.735941 18168 raft_consensus.cc:2219] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 0. I0516 22:02:32.735965 18323 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.736078 18133 leader_election.cc:379] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Vote granted by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.736124 18133 leader_election.cc:270] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. I0516 22:02:32.736405 18170 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.568s (vote granted) I0516 22:02:32.737370 18099 raft_consensus.cc:2219] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b141e05cb0444865b490089e568edadc in term 1. I0516 22:02:32.737713 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" is_pre_election: true I0516 22:02:32.737819 18237 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.519s (vote granted) I0516 22:02:32.737875 18237 raft_consensus.cc:2219] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 0. I0516 22:02:32.737931 18170 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b141e05cb0444865b490089e568edadc in term 1. I0516 22:02:32.738092 18290 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.848s (election complete) I0516 22:02:32.738144 18290 raft_consensus.cc:2511] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0516 22:02:32.738193 18290 raft_consensus.cc:435] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0516 22:02:32.738240 18290 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.013s (starting election) I0516 22:02:32.738282 18290 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.738338 18198 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.738402 18198 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0516 22:02:32.738543 18326 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.895s (election complete) I0516 22:02:32.738593 18326 raft_consensus.cc:2511] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Leader election won for term 1 I0516 22:02:32.738669 18326 raft_consensus.cc:571] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 1 LEADER]: Becoming Leader. State: Replica: b141e05cb0444865b490089e568edadc, State: Running, Role: LEADER I0516 22:02:32.738880 18326 consensus_queue.cc:204] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:32.739593 18134 leader_election.cc:379] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.739784 18063 leader_election.cc:379] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.739854 18063 leader_election.cc:270] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. I0516 22:02:32.739944 18290 raft_consensus.cc:457] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.740118 18100 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.740173 18100 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.020s (vote granted) I0516 22:02:32.740042 18066 leader_election.cc:379] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.740319 18323 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.209s (election complete) I0516 22:02:32.740233 18290 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Requesting vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.741710 18200 leader_election.cc:379] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Vote granted by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.742326 18290 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.742949 18323 raft_consensus.cc:2511] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Leader pre-election won for term 1 I0516 22:02:32.742926 18099 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" I0516 22:02:32.743067 18323 raft_consensus.cc:435] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0516 22:02:32.742913 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:32.742954 18018 catalog_manager.cc:3686] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc reported cstate change: term changed from 0 to 1, leader changed from to b141e05cb0444865b490089e568edadc (127.17.88.3). New cstate: current_term: 1 leader_uuid: "b141e05cb0444865b490089e568edadc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } health_report { overall_health: HEALTHY } } } I0516 22:02:32.744232 18100 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b141e05cb0444865b490089e568edadc in term 1. I0516 22:02:32.744412 18285 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0516 22:02:32.744470 18285 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.867s (starting election) I0516 22:02:32.744576 18200 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Vote granted by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.744537 18285 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.744730 18237 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.744782 18285 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.744794 18237 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.008s (vote granted) I0516 22:02:32.745168 18100 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "b141e05cb0444865b490089e568edadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" is_pre_election: true I0516 22:02:32.745301 18100 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.899s (vote granted) I0516 22:02:32.745344 18100 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b141e05cb0444865b490089e568edadc in term 0. I0516 22:02:32.745610 18200 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Vote granted by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.745607 18323 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.548s (starting election) I0516 22:02:32.745663 18200 leader_election.cc:270] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. I0516 22:02:32.745692 18323 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.745851 18326 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.613s (election complete) I0516 22:02:32.745899 18326 raft_consensus.cc:2511] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Leader pre-election won for term 1 I0516 22:02:32.746258 18018 catalog_manager.cc:3686] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc reported cstate change: term changed from 0 to 1, leader changed from to b141e05cb0444865b490089e568edadc (127.17.88.3). New cstate: current_term: 1 leader_uuid: "b141e05cb0444865b490089e568edadc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } health_report { overall_health: UNKNOWN } } } I0516 22:02:32.746565 18326 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0516 22:02:32.746619 18326 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.105s (starting election) I0516 22:02:32.746706 18326 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.746832 18237 raft_consensus.cc:2219] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2767dd0c676459aa9c2533260fc9d46 in term 1. I0516 22:02:32.747057 18134 leader_election.cc:379] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.747169 18134 leader_election.cc:270] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0516 22:02:32.747356 18290 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.776s (election complete) I0516 22:02:32.747414 18290 raft_consensus.cc:2511] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Leader election won for term 1 I0516 22:02:32.747500 18290 raft_consensus.cc:571] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 1 LEADER]: Becoming Leader. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Running, Role: LEADER I0516 22:02:32.747647 18290 consensus_queue.cc:204] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.748040 18285 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.748495 18170 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "b141e05cb0444865b490089e568edadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" is_pre_election: true I0516 22:02:32.748644 18170 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.979s (vote granted) I0516 22:02:32.748728 18170 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b141e05cb0444865b490089e568edadc in term 0. I0516 22:02:32.748960 18198 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 pre-election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.749012 18323 raft_consensus.cc:457] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.748945 18018 catalog_manager.cc:3686] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 reported cstate change: term changed from 0 to 1, leader changed from to d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2). New cstate: current_term: 1 leader_uuid: "d2767dd0c676459aa9c2533260fc9d46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } health_report { overall_health: UNKNOWN } } } I0516 22:02:32.749588 18099 raft_consensus.cc:2149] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d2767dd0c676459aa9c2533260fc9d46 in current term 1: Already voted for candidate d7e4c153959b4c86b9dcb5a3441a879a in this term. I0516 22:02:32.749750 18326 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.750025 18326 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Requesting vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.750032 18133 leader_election.cc:393] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Vote denied by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831). Message: Invalid argument: T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d2767dd0c676459aa9c2533260fc9d46 in current term 1: Already voted for candidate d7e4c153959b4c86b9dcb5a3441a879a in this term. I0516 22:02:32.750229 18323 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.750267 18326 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.750439 18099 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "b141e05cb0444865b490089e568edadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" I0516 22:02:32.750519 18323 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.750571 18099 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.750635 18099 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.750s (vote granted) I0516 22:02:32.750680 18170 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "b141e05cb0444865b490089e568edadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:32.750802 18170 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.750854 18170 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.166s (vote granted) I0516 22:02:32.750995 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:32.751128 18237 raft_consensus.cc:2149] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a in current term 1: Already voted for candidate d2767dd0c676459aa9c2533260fc9d46 in this term. I0516 22:02:32.751426 18066 leader_election.cc:393] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a in current term 1: Already voted for candidate d2767dd0c676459aa9c2533260fc9d46 in this term. I0516 22:02:32.752038 18099 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b141e05cb0444865b490089e568edadc in term 1. I0516 22:02:32.752209 18170 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b141e05cb0444865b490089e568edadc in term 1. I0516 22:02:32.752336 18200 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Vote granted by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.752395 18200 leader_election.cc:270] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0516 22:02:32.752420 18168 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:32.752559 18168 raft_consensus.cc:2180] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 1 LEADER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 1 because replica is either leader or believes a valid leader to be alive. I0516 22:02:32.752564 18285 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.230s (election complete) I0516 22:02:32.752642 18285 raft_consensus.cc:2511] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Leader election won for term 1 I0516 22:02:32.752708 18285 raft_consensus.cc:571] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 1 LEADER]: Becoming Leader. State: Replica: b141e05cb0444865b490089e568edadc, State: Running, Role: LEADER I0516 22:02:32.752918 18063 leader_election.cc:393] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 1 LEADER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 1 because replica is either leader or believes a valid leader to be alive. I0516 22:02:32.752979 18063 leader_election.cc:270] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. I0516 22:02:32.752843 18285 consensus_queue.cc:204] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.753111 18323 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.534s (election complete) I0516 22:02:32.753177 18323 raft_consensus.cc:2459] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority I0516 22:02:32.753206 18198 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [CANDIDATE]: Term 1 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.753690 18323 raft_consensus.cc:435] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0516 22:02:32.753768 18323 raft_consensus.cc:2704] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.660s (starting election) I0516 22:02:32.753834 18323 raft_consensus.cc:457] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.754107 18323 leader_election.cc:243] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.754240 18323 leader_election.cc:243] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.754238 18018 catalog_manager.cc:3686] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc reported cstate change: term changed from 0 to 1, leader changed from to b141e05cb0444865b490089e568edadc (127.17.88.3). New cstate: current_term: 1 leader_uuid: "b141e05cb0444865b490089e568edadc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } health_report { overall_health: HEALTHY } } } I0516 22:02:32.754520 18168 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" is_pre_election: true I0516 22:02:32.754642 18168 raft_consensus.cc:2704] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.608s (vote granted) I0516 22:02:32.754694 18168 raft_consensus.cc:2219] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 0. I0516 22:02:32.754664 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" is_pre_election: true I0516 22:02:32.754794 18237 raft_consensus.cc:2704] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.916s (vote granted) I0516 22:02:32.754843 18237 raft_consensus.cc:2219] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 0. I0516 22:02:32.754952 18063 leader_election.cc:379] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.755002 18063 leader_election.cc:270] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. I0516 22:02:32.755105 18066 leader_election.cc:379] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.755129 18323 raft_consensus.cc:2704] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.964s (election complete) I0516 22:02:32.755177 18323 raft_consensus.cc:2511] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Leader pre-election won for term 1 I0516 22:02:32.755244 18323 raft_consensus.cc:435] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0516 22:02:32.755285 18323 raft_consensus.cc:2704] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.873s (starting election) I0516 22:02:32.755326 18323 raft_consensus.cc:2756] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.756564 18323 raft_consensus.cc:457] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.756803 18323 leader_election.cc:243] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.756898 18323 leader_election.cc:243] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.757243 18168 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:32.757302 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:32.757362 18168 raft_consensus.cc:2756] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.757436 18237 raft_consensus.cc:2756] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.757448 18168 raft_consensus.cc:2704] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.814s (vote granted) I0516 22:02:32.757501 18237 raft_consensus.cc:2704] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.595s (vote granted) I0516 22:02:32.758827 18168 raft_consensus.cc:2219] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 1. I0516 22:02:32.759079 18237 raft_consensus.cc:2219] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 1. I0516 22:02:32.759094 18063 leader_election.cc:379] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.759217 18063 leader_election.cc:270] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0516 22:02:32.759415 18323 raft_consensus.cc:2704] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.705s (election complete) I0516 22:02:32.759419 18066 leader_election.cc:379] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.759472 18323 raft_consensus.cc:2511] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Leader election won for term 1 I0516 22:02:32.759558 18323 raft_consensus.cc:571] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Becoming Leader. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Running, Role: LEADER I0516 22:02:32.759681 18323 consensus_queue.cc:204] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.760998 18018 catalog_manager.cc:3686] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a reported cstate change: term changed from 0 to 1, leader changed from to d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1). New cstate: current_term: 1 leader_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } health_report { overall_health: UNKNOWN } } } I0516 22:02:32.775317 18323 raft_consensus.cc:435] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0516 22:02:32.775380 18323 raft_consensus.cc:2704] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.939s (starting election) I0516 22:02:32.775449 18323 raft_consensus.cc:457] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.775745 18323 leader_election.cc:243] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.775866 18323 leader_election.cc:243] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.776402 18168 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" is_pre_election: true I0516 22:02:32.776413 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" is_pre_election: true I0516 22:02:32.776531 18168 raft_consensus.cc:2704] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.866s (vote granted) I0516 22:02:32.776571 18237 raft_consensus.cc:2704] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.847s (vote granted) I0516 22:02:32.776598 18168 raft_consensus.cc:2219] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 0. I0516 22:02:32.776638 18237 raft_consensus.cc:2219] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 0. I0516 22:02:32.776903 18063 leader_election.cc:379] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.776957 18063 leader_election.cc:270] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. I0516 22:02:32.777029 18066 leader_election.cc:379] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 pre-election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.777091 18323 raft_consensus.cc:2704] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.057s (election complete) I0516 22:02:32.777145 18323 raft_consensus.cc:2511] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Leader pre-election won for term 1 I0516 22:02:32.777179 18323 raft_consensus.cc:435] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0516 22:02:32.777220 18323 raft_consensus.cc:2704] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.204s (starting election) I0516 22:02:32.777251 18323 raft_consensus.cc:2756] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.778601 18323 raft_consensus.cc:457] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.778832 18323 leader_election.cc:243] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.778949 18323 leader_election.cc:243] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.779256 18168 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:32.779405 18168 raft_consensus.cc:2756] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.779458 18168 raft_consensus.cc:2704] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.795s (vote granted) I0516 22:02:32.779433 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:32.779548 18237 raft_consensus.cc:2756] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.779598 18237 raft_consensus.cc:2704] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.238s (vote granted) I0516 22:02:32.780800 18168 raft_consensus.cc:2219] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 1. I0516 22:02:32.780982 18237 raft_consensus.cc:2219] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 1. I0516 22:02:32.781080 18063 leader_election.cc:379] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:32.781136 18063 leader_election.cc:270] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0516 22:02:32.781240 18066 leader_election.cc:379] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 1 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.781296 18323 raft_consensus.cc:2704] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.176s (election complete) I0516 22:02:32.781373 18323 raft_consensus.cc:2511] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Leader election won for term 1 I0516 22:02:32.781447 18323 raft_consensus.cc:571] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Becoming Leader. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Running, Role: LEADER I0516 22:02:32.781602 18323 consensus_queue.cc:204] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.783129 18018 catalog_manager.cc:3686] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a reported cstate change: term changed from 0 to 1, leader changed from to d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1). New cstate: current_term: 1 leader_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } health_report { overall_health: UNKNOWN } } } I0516 22:02:32.790549 18290 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0516 22:02:32.790606 18290 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.990s (starting election) I0516 22:02:32.790670 18290 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.790910 18290 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.791031 18290 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.791456 18099 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" is_pre_election: true I0516 22:02:32.791499 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" is_pre_election: true I0516 22:02:32.791579 18099 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.654s (vote granted) I0516 22:02:32.791641 18237 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.959s (vote granted) I0516 22:02:32.791649 18099 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2767dd0c676459aa9c2533260fc9d46 in term 0. I0516 22:02:32.791683 18237 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2767dd0c676459aa9c2533260fc9d46 in term 0. I0516 22:02:32.791903 18133 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Vote granted by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.791972 18133 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. I0516 22:02:32.792034 18134 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.792112 18290 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.919s (election complete) I0516 22:02:32.792170 18290 raft_consensus.cc:2511] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0516 22:02:32.792201 18290 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0516 22:02:32.792243 18290 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.135s (starting election) I0516 22:02:32.792275 18290 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.793632 18290 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.793857 18290 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Requesting vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.793982 18290 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.794243 18099 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" I0516 22:02:32.794356 18099 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.794412 18099 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.687s (vote granted) I0516 22:02:32.794394 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:32.794493 18237 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.794555 18237 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.839s (vote granted) I0516 22:02:32.795866 18099 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2767dd0c676459aa9c2533260fc9d46 in term 1. I0516 22:02:32.796022 18237 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2767dd0c676459aa9c2533260fc9d46 in term 1. I0516 22:02:32.796105 18133 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Vote granted by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.796175 18133 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0516 22:02:32.796309 18134 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.796324 18290 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.181s (election complete) I0516 22:02:32.796403 18290 raft_consensus.cc:2511] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Leader election won for term 1 I0516 22:02:32.796478 18290 raft_consensus.cc:571] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 1 LEADER]: Becoming Leader. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Running, Role: LEADER I0516 22:02:32.796663 18290 consensus_queue.cc:204] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.798130 18018 catalog_manager.cc:3686] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 reported cstate change: term changed from 0 to 1, leader changed from to d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2). New cstate: current_term: 1 leader_uuid: "d2767dd0c676459aa9c2533260fc9d46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } health_report { overall_health: UNKNOWN } } } I0516 22:02:32.953665 18290 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0516 22:02:32.953788 18290 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.056s (starting election) I0516 22:02:32.953868 18290 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.954221 18290 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.954382 18290 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.954872 18099 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" is_pre_election: true I0516 22:02:32.954994 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" is_pre_election: true I0516 22:02:32.955056 18099 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.234s (vote granted) I0516 22:02:32.955121 18099 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2767dd0c676459aa9c2533260fc9d46 in term 0. I0516 22:02:32.955132 18237 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.633s (vote granted) I0516 22:02:32.955230 18237 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2767dd0c676459aa9c2533260fc9d46 in term 0. I0516 22:02:32.955451 18133 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Vote granted by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.955513 18133 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. I0516 22:02:32.955566 18134 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 pre-election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.955677 18290 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.847s (election complete) I0516 22:02:32.955744 18290 raft_consensus.cc:2511] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0516 22:02:32.955787 18290 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0516 22:02:32.955824 18290 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.958s (starting election) I0516 22:02:32.955869 18290 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.957445 18290 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.957696 18290 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Requesting vote from peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.957811 18290 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.958225 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:32.958216 18099 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d2767dd0c676459aa9c2533260fc9d46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" I0516 22:02:32.958346 18099 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.958350 18237 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Advancing to term 1 I0516 22:02:32.958417 18099 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.049s (vote granted) I0516 22:02:32.958420 18237 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.668s (vote granted) I0516 22:02:32.959861 18237 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2767dd0c676459aa9c2533260fc9d46 in term 1. I0516 22:02:32.959863 18099 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2767dd0c676459aa9c2533260fc9d46 in term 1. I0516 22:02:32.960167 18133 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Vote granted by peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831) I0516 22:02:32.960233 18133 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0516 22:02:32.960356 18134 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [CANDIDATE]: Term 1 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:32.960397 18290 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.953s (election complete) I0516 22:02:32.960449 18290 raft_consensus.cc:2511] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Leader election won for term 1 I0516 22:02:32.960527 18290 raft_consensus.cc:571] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 1 LEADER]: Becoming Leader. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Running, Role: LEADER I0516 22:02:32.960677 18290 consensus_queue.cc:204] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:32.962281 18018 catalog_manager.cc:3686] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 reported cstate change: term changed from 0 to 1, leader changed from to d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2). New cstate: current_term: 1 leader_uuid: "d2767dd0c676459aa9c2533260fc9d46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } health_report { overall_health: UNKNOWN } } } I0516 22:02:33.064893 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.065080 18099 raft_consensus.cc:418] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.065063 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.065176 18100 raft_consensus.cc:435] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.065243 18100 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.564s (starting election) I0516 22:02:33.065300 18100 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.065701 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.065976 18099 raft_consensus.cc:418] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.066087 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.066171 18102 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.066236 18102 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.950s (starting election) I0516 22:02:33.066283 18102 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.066915 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.067440 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.067361 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.067636 18099 raft_consensus.cc:418] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.067711 18098 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.068080 18101 raft_consensus.cc:435] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.068184 18101 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.163s (starting election) I0516 22:02:33.068544 18101 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.068707 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.068794 18098 raft_consensus.cc:418] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.068922 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.068995 18099 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.069073 18102 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.069403 18102 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.069561 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.069641 18099 raft_consensus.cc:418] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.069864 18102 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.070000 18101 raft_consensus.cc:457] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.070607 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.070556 18100 raft_consensus.cc:457] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.070724 18101 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.070873 18237 raft_consensus.cc:2751] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 1 LEADER]: Stepping down as leader of term 1 I0516 22:02:33.070899 18101 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.070932 18100 leader_election.cc:243] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.070938 18237 raft_consensus.cc:604] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b141e05cb0444865b490089e568edadc, State: Running, Role: LEADER I0516 22:02:33.070780 18168 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.071177 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.071388 18168 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.071450 18168 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.172s (vote granted) I0516 22:02:33.071708 18170 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.071842 18100 leader_election.cc:243] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.072029 18236 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.072126 18236 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.072518 18236 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.523s (vote granted) I0516 22:02:33.072767 18099 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.072523 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.072422 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.072856 18169 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.072813 18237 consensus_queue.cc:227] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.084161 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.084455 18235 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 0 FOLLOWER]: Advancing to term 2 I0516 22:02:33.084913 18170 raft_consensus.cc:2751] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 1 LEADER]: Stepping down as leader of term 1 I0516 22:02:33.084877 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.085198 18237 consensus_peers.cc:456] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc -> Peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831): Closing peer: d7e4c153959b4c86b9dcb5a3441a879a I0516 22:02:33.085336 18170 raft_consensus.cc:604] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Running, Role: LEADER I0516 22:02:33.085391 18099 raft_consensus.cc:435] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.085623 18100 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.085664 18235 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.872s (vote granted) I0516 22:02:33.085702 18100 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.640s (starting election) I0516 22:02:33.085817 18100 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.085584 18169 raft_consensus.cc:2751] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 1 LEADER]: Stepping down as leader of term 1 I0516 22:02:33.085568 18102 raft_consensus.cc:418] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.087121 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.087260 18097 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.087396 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.087908 18237 consensus_peers.cc:456] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc -> Peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101): Closing peer: d2767dd0c676459aa9c2533260fc9d46 I0516 22:02:33.088074 18237 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.088486 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.088560 18169 raft_consensus.cc:604] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Running, Role: LEADER I0516 22:02:33.089402 18098 raft_consensus.cc:435] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.089920 18098 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.738s (starting election) I0516 22:02:33.090103 18102 raft_consensus.cc:418] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.090126 18098 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.090373 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.089427 18170 consensus_queue.cc:227] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.090580 18170 consensus_peers.cc:456] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 -> Peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899): Closing peer: b141e05cb0444865b490089e568edadc I0516 22:02:33.090646 18169 consensus_queue.cc:227] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.090800 18169 consensus_peers.cc:456] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 -> Peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899): Closing peer: b141e05cb0444865b490089e568edadc I0516 22:02:33.091158 18169 consensus_peers.cc:456] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 -> Peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831): Closing peer: d7e4c153959b4c86b9dcb5a3441a879a I0516 22:02:33.091126 18100 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.091265 18169 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.091681 18097 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.092002 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.092182 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.092277 18101 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.092449 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.092552 18097 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.092814 18100 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.093883 18099 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.263s (starting election) I0516 22:02:33.094282 18099 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.096341 18100 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.097420 18102 raft_consensus.cc:418] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.097440 18101 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.629s (starting election) I0516 22:02:33.097764 18168 raft_consensus.cc:2219] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 2. I0516 22:02:33.097580 18236 raft_consensus.cc:2219] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 2. I0516 22:02:33.097987 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.098230 18097 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.098251 18063 leader_election.cc:379] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.098244 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.098314 18063 leader_election.cc:270] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0516 22:02:33.098543 18170 consensus_peers.cc:456] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 -> Peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831): Closing peer: d7e4c153959b4c86b9dcb5a3441a879a I0516 22:02:33.098863 18101 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.099146 18102 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.099231 18170 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.099550 18102 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.695s (starting election) I0516 22:02:33.100016 18102 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Advancing to term 4 I0516 22:02:33.100510 18169 raft_consensus.cc:2166] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.100046 18234 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.101200 18098 raft_consensus.cc:457] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.101532 18063 leader_election.cc:393] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.101528 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.101775 18096 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.102037 18235 raft_consensus.cc:2219] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 2. I0516 22:02:33.102080 18066 leader_election.cc:379] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.101791 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.102277 18066 leader_election.cc:270] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0516 22:02:33.102288 18167 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.102438 18098 leader_election.cc:243] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.103363 18102 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.103639 18323 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.742s (election complete) I0516 22:02:33.103658 18167 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.218s (vote granted) I0516 22:02:33.103878 18323 raft_consensus.cc:2474] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Leader election decision vote started in defunct term 2: won I0516 22:02:33.104183 18098 leader_election.cc:243] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.104842 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.104817 18099 raft_consensus.cc:457] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.105098 18289 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.089s (election complete) I0516 22:02:33.105103 18098 raft_consensus.cc:435] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.105319 18289 raft_consensus.cc:2474] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won I0516 22:02:33.105296 18169 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.105877 18099 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.106163 18098 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.839s (starting election) I0516 22:02:33.106427 18096 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.502s (starting election) I0516 22:02:33.106632 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.106793 18096 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.106931 18167 raft_consensus.cc:2219] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 3. I0516 22:02:33.106997 18066 leader_election.cc:379] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.107259 18063 leader_election.cc:379] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.107424 18097 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.106879 18168 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.107825 18170 raft_consensus.cc:2166] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.108041 18066 leader_election.cc:270] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0516 22:02:33.108265 18102 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.108484 18237 raft_consensus.cc:2166] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.108655 18234 raft_consensus.cc:2194] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.109016 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.109732 18102 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.109969 18168 raft_consensus.cc:2194] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.109993 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.110239 18169 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.110105 18100 raft_consensus.cc:418] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.110608 18099 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.110586 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.110878 18100 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.110883 18098 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Advancing to term 4 I0516 22:02:33.110999 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.111023 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.111467 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.111553 18099 raft_consensus.cc:418] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.111696 18237 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.111762 18237 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.156s (vote granted) I0516 22:02:33.111537 18094 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.112157 18097 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.112174 18066 leader_election.cc:393] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.111287 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.112613 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.112695 18095 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.112712 18097 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.113354 18083 tablet_service.cc:801] Processing DeleteTablet for tablet 807b2c351057419d846ab8586e3ed167 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.112027 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.113523 18100 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.836s (starting election) I0516 22:02:33.113646 18100 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.113734 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.113816 18102 raft_consensus.cc:435] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.113965 18102 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.576s (starting election) I0516 22:02:33.114020 18102 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Advancing to term 4 I0516 22:02:33.113881 18095 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.061s (starting election) I0516 22:02:33.114423 18099 raft_consensus.cc:418] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.115002 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.115250 18101 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.116083 18095 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.116705 18101 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.116981 18169 raft_consensus.cc:2166] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.117347 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.117542 18094 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.117568 18063 leader_election.cc:270] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. I0516 22:02:33.117560 18098 raft_consensus.cc:457] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.117658 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.118346 18066 leader_election.cc:393] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.118510 18289 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.124s (election complete) I0516 22:02:33.117933 18096 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.118794 18096 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.119735 18097 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.119962 18063 leader_election.cc:393] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.120510 18063 leader_election.cc:393] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.122014 18099 raft_consensus.cc:418] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.122299 18168 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.122871 18063 leader_election.cc:393] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.122305 18170 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.123010 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.123261 18098 leader_election.cc:243] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.121536 18100 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.123626 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.124032 18094 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.124264 18323 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.231s (election complete) I0516 22:02:33.124343 18289 raft_consensus.cc:2474] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Leader election decision vote started in defunct term 2: won I0516 22:02:33.124415 18100 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.124541 18098 leader_election.cc:243] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.124856 18234 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.125072 18234 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Advancing to term 4 I0516 22:02:33.125269 18096 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.125952 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.126227 18101 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.126389 18236 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.126603 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.127029 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.127061 18237 raft_consensus.cc:2219] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 3. I0516 22:02:33.127259 18168 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.127319 18168 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.086s (vote granted) I0516 22:02:33.127485 18066 leader_election.cc:379] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.127534 18066 leader_election.cc:270] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. I0516 22:02:33.127996 18170 raft_consensus.cc:2751] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 1 LEADER]: Stepping down as leader of term 1 I0516 22:02:33.127998 18102 raft_consensus.cc:457] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.128157 18099 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.128026 18232 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.128253 18232 raft_consensus.cc:2751] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 1 LEADER]: Stepping down as leader of term 1 I0516 22:02:33.128109 18236 raft_consensus.cc:2194] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.128305 18102 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.128311 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.128389 18170 raft_consensus.cc:604] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Running, Role: LEADER I0516 22:02:33.128571 18232 raft_consensus.cc:604] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b141e05cb0444865b490089e568edadc, State: Running, Role: LEADER I0516 22:02:33.128672 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.128830 18167 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 3 FOLLOWER]: Advancing to term 4 I0516 22:02:33.128823 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.129019 18165 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Advancing to term 4 I0516 22:02:33.129053 18232 consensus_queue.cc:227] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.129173 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.129307 18323 raft_consensus.cc:2474] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Leader election decision vote started in defunct term 3: won I0516 22:02:33.129532 18066 leader_election.cc:393] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.131299 18100 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.131330 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.131448 18235 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.131590 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.131692 18098 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.131896 18235 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.550s (vote granted) I0516 22:02:33.132776 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.132947 18233 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.133110 18233 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.133177 18233 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.882s (vote granted) I0516 22:02:33.133601 18235 raft_consensus.cc:2219] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 3. I0516 22:02:33.133679 18165 raft_consensus.cc:2166] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.133664 18236 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.133900 18066 leader_election.cc:379] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.134021 18234 raft_consensus.cc:2166] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.134176 18093 raft_consensus.cc:1057] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Refusing update from remote peer b141e05cb0444865b490089e568edadc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0516 22:02:33.134400 18066 leader_election.cc:270] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. I0516 22:02:33.134557 18323 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.132s (election complete) I0516 22:02:33.134670 18323 raft_consensus.cc:2474] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won I0516 22:02:33.134690 18066 leader_election.cc:393] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.134737 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.134778 18097 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.134786 18285 consensus_queue.cc:963] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0516 22:02:33.134917 18236 raft_consensus.cc:2194] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 5 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.134914 18099 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.134968 18099 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.640s (starting election) I0516 22:02:33.135030 18099 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.135272 18097 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.560s (starting election) I0516 22:02:33.135339 18097 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.135321 18066 leader_election.cc:393] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 5 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.135499 18233 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 2. I0516 22:02:33.135896 18095 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.135720 18170 consensus_queue.cc:227] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.136312 18066 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.136435 18232 consensus_peers.cc:456] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc -> Peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101): Closing peer: d2767dd0c676459aa9c2533260fc9d46 I0516 22:02:33.136466 18095 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.136508 18232 consensus_peers.cc:456] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc -> Peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831): Closing peer: d7e4c153959b4c86b9dcb5a3441a879a I0516 22:02:33.136483 18166 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.136675 18170 consensus_peers.cc:456] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 -> Peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899): Closing peer: b141e05cb0444865b490089e568edadc I0516 22:02:33.136749 18168 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 2. I0516 22:02:33.136806 18166 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 3 FOLLOWER]: Advancing to term 5 I0516 22:02:33.137110 18095 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.137228 18167 raft_consensus.cc:2166] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.137491 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.137583 18098 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.137727 18098 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.134s (starting election) I0516 22:02:33.137799 18098 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.137794 18101 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.137845 18101 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.957s (starting election) I0516 22:02:33.137944 18101 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.138214 18169 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.138502 18093 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.138880 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.138873 18099 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.139039 18093 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.139093 18093 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.170s (starting election) I0516 22:02:33.139948 18101 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.140197 18099 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.140293 18099 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.140446 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.140529 18099 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.140638 18102 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.140774 18066 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0516 22:02:33.140873 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.141072 18323 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.059s (election complete) I0516 22:02:33.141075 18102 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.141144 18323 raft_consensus.cc:2474] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won I0516 22:02:33.141181 18102 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.156s (starting election) I0516 22:02:33.141249 18232 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.141413 18234 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.142606 18232 raft_consensus.cc:2166] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.142765 18102 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Advancing to term 4 I0516 22:02:33.142786 18170 consensus_peers.cc:456] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 -> Peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831): Closing peer: d7e4c153959b4c86b9dcb5a3441a879a I0516 22:02:33.142879 18170 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.142889 18066 leader_election.cc:393] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.142985 18166 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.155s (vote granted) I0516 22:02:33.143004 18100 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.143143 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.143376 18063 leader_election.cc:393] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.143602 18063 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.143751 18063 leader_election.cc:270] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0516 22:02:33.144239 18063 leader_election.cc:393] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.144327 18063 leader_election.cc:270] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. I0516 22:02:33.144289 18102 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.144572 18168 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.144568 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.145776 18166 raft_consensus.cc:2219] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 5. I0516 22:02:33.145884 18169 raft_consensus.cc:2194] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.146155 18063 leader_election.cc:379] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.146347 18323 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.034s (election complete) I0516 22:02:33.146383 18346 tablet_replica.cc:261] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: stopping tablet replica I0516 22:02:33.146437 18323 raft_consensus.cc:2474] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Leader election decision vote started in defunct term 2: won I0516 22:02:33.146401 18097 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.146533 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op CompactRowSetsOp(807b2c351057419d846ab8586e3ed167) I0516 22:02:33.146612 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MinorDeltaCompactionOp(807b2c351057419d846ab8586e3ed167) I0516 22:02:33.146661 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MajorDeltaCompactionOp(807b2c351057419d846ab8586e3ed167) I0516 22:02:33.146713 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op UndoDeltaBlockGCOp(807b2c351057419d846ab8586e3ed167) I0516 22:02:33.146766 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushMRSOp(807b2c351057419d846ab8586e3ed167) I0516 22:02:33.146821 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushDeltaMemStoresOp(807b2c351057419d846ab8586e3ed167) I0516 22:02:33.146828 18097 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.146854 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op LogGCOp(807b2c351057419d846ab8586e3ed167) I0516 22:02:33.146831 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.146885 18095 raft_consensus.cc:1025] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Rejecting Update request from peer b141e05cb0444865b490089e568edadc for earlier term 1. Current term is 2. Ops: [] I0516 22:02:33.147027 18346 raft_consensus.cc:2016] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Raft consensus shutting down. I0516 22:02:33.147052 18094 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.147089 18346 consensus_peers.cc:456] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a -> Peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899): Closing peer: b141e05cb0444865b490089e568edadc I0516 22:02:33.147573 18101 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.147644 18232 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.147727 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.147683 18101 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.147832 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.148088 18096 raft_consensus.cc:435] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.148150 18096 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.619s (starting election) I0516 22:02:33.148216 18096 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.148469 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.148577 18235 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.148669 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.147835 18095 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.148815 18094 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.148947 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.149024 18099 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.149185 18100 raft_consensus.cc:435] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.149206 18093 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.149235 18100 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.754s (starting election) I0516 22:02:33.150143 18096 raft_consensus.cc:457] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.150425 18289 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.991s (election complete) I0516 22:02:33.150696 18093 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.150960 18100 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.151063 18170 raft_consensus.cc:2166] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.151098 18063 leader_election.cc:270] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. I0516 22:02:33.151015 18167 raft_consensus.cc:2751] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 1 LEADER]: Stepping down as leader of term 1 I0516 22:02:33.151525 18167 raft_consensus.cc:604] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2767dd0c676459aa9c2533260fc9d46, State: Running, Role: LEADER W0516 22:02:33.151736 18063 leader_election.cc:363] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) with higher term. Message: Service unavailable: T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.151844 18097 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.151899 18102 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.152014 18102 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.152415 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.152431 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.152627 18098 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.152732 18100 raft_consensus.cc:457] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.152911 18098 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.152931 18323 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.994s (election complete) I0516 22:02:33.153019 18323 raft_consensus.cc:2474] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won I0516 22:02:33.153216 18098 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.153316 18346 consensus_peers.cc:456] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a -> Peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101): Closing peer: d2767dd0c676459aa9c2533260fc9d46 I0516 22:02:33.153306 18233 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.153432 18235 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.793s (vote granted) I0516 22:02:33.153878 18233 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.153962 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.153990 18094 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.684s (starting election) I0516 22:02:33.154053 18094 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Advancing to term 4 I0516 22:02:33.154412 18234 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 3 FOLLOWER]: Advancing to term 4 I0516 22:02:33.154719 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.154784 18234 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.570s (vote granted) I0516 22:02:33.154942 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.155071 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.155192 18095 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.155647 18346 pending_rounds.cc:63] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: Trying to abort 1 pending transactions. I0516 22:02:33.155712 18168 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.155793 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.155833 18096 leader_election.cc:243] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.155896 18099 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.155942 18096 leader_election.cc:243] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.156092 18235 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 3. I0516 22:02:33.157285 18168 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.111s (vote granted) I0516 22:02:33.157547 18093 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.157527 18346 pending_rounds.cc:68] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } timestamp: 6252577393508761600 op_type: NO_OP noop_request { } I0516 22:02:33.157680 18093 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.157686 18346 raft_consensus.cc:2594] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0516 22:02:33.158844 18346 raft_consensus.cc:2043] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Raft consensus is shut down! I0516 22:02:33.158927 18063 leader_election.cc:366] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term I0516 22:02:33.158963 18237 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Advancing to term 4 I0516 22:02:33.158969 18097 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.159027 18097 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.988s (starting election) I0516 22:02:33.159296 18097 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.159814 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.159806 18170 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.160421 18346 ts_tablet_manager.cc:1369] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting tablet data with delete state TABLET_DATA_DELETED I0516 22:02:33.161700 18236 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.161824 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 6 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.162287 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.162715 18233 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.087s (vote granted) I0516 22:02:33.163113 18237 raft_consensus.cc:2166] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.163144 18097 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.163269 18236 raft_consensus.cc:2194] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.164274 18102 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.164239 18231 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 6 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.162937 18285 consensus_queue.cc:974] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s I0516 22:02:33.164822 18101 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.164911 18231 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Advancing to term 6 I0516 22:02:33.164993 18233 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 2. I0516 22:02:33.165184 18101 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.141s (starting election) I0516 22:02:33.165275 18289 raft_consensus.cc:2474] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Leader election decision vote started in defunct term 3: won I0516 22:02:33.165371 18232 raft_consensus.cc:2751] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 1 LEADER]: Stepping down as leader of term 1 I0516 22:02:33.165369 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.166039 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.166070 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.167392 18234 raft_consensus.cc:2219] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 4. I0516 22:02:33.167553 18066 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.167613 18066 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. W0516 22:02:33.167912 18066 leader_election.cc:363] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) with higher term. Message: Service unavailable: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.167950 18066 leader_election.cc:366] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term I0516 22:02:33.168222 18066 leader_election.cc:393] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.168352 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.168452 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0516 22:02:33.168499 18231 raft_consensus.cc:2166] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 6 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.168704 18231 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.168809 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.168916 18099 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.168843 18167 consensus_queue.cc:227] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.168995 18167 consensus_peers.cc:456] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 -> Peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899): Closing peer: b141e05cb0444865b490089e568edadc I0516 22:02:33.169203 18167 consensus_peers.cc:456] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 -> Peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831): Closing peer: d7e4c153959b4c86b9dcb5a3441a879a I0516 22:02:33.169277 18167 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.169898 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.170187 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.170310 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.170342 18168 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 3. I0516 22:02:33.170392 18099 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.171823 18235 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 3 FOLLOWER]: Advancing to term 5 I0516 22:02:33.171931 18100 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.172075 18098 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.172077 18170 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.172202 18100 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.173925 18170 raft_consensus.cc:2166] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.173957 18235 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.113s (vote granted) I0516 22:02:33.174204 18169 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.174553 18165 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.174245 18163 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.174624 18165 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.054s (vote granted) I0516 22:02:33.175134 18166 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.175385 18169 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.175498 18097 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.175587 18102 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.869s (starting election) I0516 22:02:33.175617 18097 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.175622 18101 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Advancing to term 7 I0516 22:02:33.175658 18102 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.175966 18166 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 3 FOLLOWER]: Advancing to term 4 I0516 22:02:33.176156 18166 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.733s (vote granted) I0516 22:02:33.176473 18232 raft_consensus.cc:604] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b141e05cb0444865b490089e568edadc, State: Running, Role: LEADER I0516 22:02:33.176702 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.176815 18097 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.176945 18097 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.871s (starting election) I0516 22:02:33.176995 18097 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Advancing to term 4 I0516 22:02:33.178727 18231 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.178745 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.178920 18093 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.179064 18066 leader_election.cc:379] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.179800 18166 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 4. I0516 22:02:33.180449 18101 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.181124 18231 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.948s (vote granted) I0516 22:02:33.178041 18232 consensus_queue.cc:227] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.181525 18323 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.685s (election complete) I0516 22:02:33.181474 18094 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.181787 18063 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.181990 18346 ts_tablet_manager.cc:1382] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1 I0516 22:02:33.182010 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.182103 18289 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.202s (election complete) I0516 22:02:33.182122 18099 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.182112 18346 log.cc:981] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting WAL directory at /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-0-root/wals/807b2c351057419d846ab8586e3ed167 I0516 22:02:33.182130 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.182433 18289 raft_consensus.cc:2474] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won I0516 22:02:33.183281 18166 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.183651 18094 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.183825 18166 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.183821 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.183933 18100 raft_consensus.cc:435] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.184168 18100 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.830s (starting election) I0516 22:02:33.184315 18100 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.184284 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.184409 18098 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.186357 18235 raft_consensus.cc:2219] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 5. I0516 22:02:33.186410 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.186679 18093 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.143s (starting election) I0516 22:02:33.186735 18093 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 3 FOLLOWER]: Advancing to term 4 I0516 22:02:33.187101 18162 raft_consensus.cc:1057] T fde57a2e13af4bcc9077306cd4109c3e P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Refusing update from remote peer d7e4c153959b4c86b9dcb5a3441a879a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0516 22:02:33.187230 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.187500 18231 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 3. I0516 22:02:33.187721 18101 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.187839 18101 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.188025 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.188282 18323 raft_consensus.cc:2459] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) with higher term. Message: Service unavailable: T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.188253 18097 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.188509 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.188510 18093 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.188774 18095 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.188834 18093 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.188836 18095 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.565s (starting election) I0516 22:02:33.188940 18097 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.188951 18063 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.187007 18347 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.940s (election complete) I0516 22:02:33.189007 18063 leader_election.cc:270] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. I0516 22:02:33.189076 18347 raft_consensus.cc:2459] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority I0516 22:02:33.189106 18097 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.189105 18289 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.045s (election complete) I0516 22:02:33.189138 18096 raft_consensus.cc:435] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.190110 18289 raft_consensus.cc:2474] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Leader election decision vote started in defunct term 2: won I0516 22:02:33.190305 18093 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.190476 18162 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.190723 18168 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 7 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.190901 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.190976 18169 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.674s (vote granted) I0516 22:02:33.191006 18097 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.191011 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.191045 18097 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.100s (starting election) I0516 22:02:33.191115 18097 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.192456 18169 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 2. I0516 22:02:33.192503 18097 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.192639 18169 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.192778 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.192801 18094 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.192834 18166 raft_consensus.cc:2166] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 5 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.192838 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0516 22:02:33.192806 18346 ts_tablet_manager.cc:1402] T 807b2c351057419d846ab8586e3ed167 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting consensus metadata I0516 22:02:33.193015 18289 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.242s (election complete) I0516 22:02:33.193022 18165 raft_consensus.cc:2219] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 6. I0516 22:02:33.193073 18289 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Leader election decision vote started in defunct term 2: won I0516 22:02:33.193112 18168 raft_consensus.cc:2194] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 7 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.193162 18063 leader_election.cc:393] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 5 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.193428 18063 leader_election.cc:393] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 7 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.193564 18232 consensus_peers.cc:456] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc -> Peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101): Closing peer: d2767dd0c676459aa9c2533260fc9d46 I0516 22:02:33.193562 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.193624 18232 consensus_peers.cc:456] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc -> Peer d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1:47831): Closing peer: d7e4c153959b4c86b9dcb5a3441a879a I0516 22:02:33.193668 18094 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.193737 18094 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.950s (starting election) I0516 22:02:33.193753 18066 leader_election.cc:270] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. I0516 22:02:33.193765 18063 leader_election.cc:379] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.193830 18063 leader_election.cc:270] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. I0516 22:02:33.193964 18094 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.194202 18083 tablet_service.cc:801] Processing DeleteTablet for tablet ab7b2ac793a4455e9bbe98795c6a392f with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.194324 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.194524 18095 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.194658 18231 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.194774 18170 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.194882 18170 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Advancing to term 3 I0516 22:02:33.194908 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.194944 18170 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.936s (vote granted) I0516 22:02:33.195067 18102 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.195183 18096 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.574s (starting election) I0516 22:02:33.195183 18066 leader_election.cc:393] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 6 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.195272 18096 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.195370 18102 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.195726 18346 tablet_replica.cc:261] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: stopping tablet replica I0516 22:02:33.195075 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.195719 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.195766 18234 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 7 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.195817 18099 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.194962 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.196295 18102 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.196480 18234 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 6 FOLLOWER]: Advancing to term 7 I0516 22:02:33.197098 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.197219 18237 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 3 FOLLOWER]: Advancing to term 4 I0516 22:02:33.197198 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.197348 18237 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.869s (vote granted) I0516 22:02:33.197643 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.197916 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.197921 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.198015 18099 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.198168 18167 raft_consensus.cc:2166] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.198130 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.198426 18163 raft_consensus.cc:2194] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.199625 18232 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Advancing to term 2 I0516 22:02:33.199621 18165 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.199736 18165 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.650s (vote granted) I0516 22:02:33.200814 18169 raft_consensus.cc:2194] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.201359 18094 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.201979 18234 raft_consensus.cc:2166] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 7 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.201997 18170 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 3. I0516 22:02:33.201994 18348 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.043s (election complete) I0516 22:02:33.202076 18348 raft_consensus.cc:2459] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) with higher term. Message: Service unavailable: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.202183 18102 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.202394 18232 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. W0516 22:02:33.202486 18285 raft_consensus.cc:746] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher. I0516 22:02:33.202664 18235 raft_consensus.cc:2194] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.203876 18237 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 4. I0516 22:02:33.203904 18231 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.203810 18095 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.203975 18231 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.646s (vote granted) I0516 22:02:33.204221 18289 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.256s (election complete) I0516 22:02:33.204521 18161 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.204524 18349 consensus_queue.cc:963] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s I0516 22:02:33.204670 18161 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 3 FOLLOWER]: Advancing to term 4 I0516 22:02:33.205870 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op CompactRowSetsOp(ab7b2ac793a4455e9bbe98795c6a392f) I0516 22:02:33.205886 18162 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 3 FOLLOWER]: Advancing to term 4 I0516 22:02:33.205976 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MinorDeltaCompactionOp(ab7b2ac793a4455e9bbe98795c6a392f) I0516 22:02:33.206001 18093 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.205957 18236 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.206178 18236 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 3 FOLLOWER]: Advancing to term 4 I0516 22:02:33.206563 18093 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.573s (starting election) I0516 22:02:33.206601 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MajorDeltaCompactionOp(ab7b2ac793a4455e9bbe98795c6a392f) I0516 22:02:33.206744 18093 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.206763 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.206887 18098 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.207079 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op UndoDeltaBlockGCOp(ab7b2ac793a4455e9bbe98795c6a392f) I0516 22:02:33.207160 18066 leader_election.cc:379] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.207226 18066 leader_election.cc:270] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. I0516 22:02:33.207093 18100 raft_consensus.cc:457] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.207475 18100 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.208261 18162 raft_consensus.cc:2166] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.209453 18093 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.209739 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushMRSOp(ab7b2ac793a4455e9bbe98795c6a392f) I0516 22:02:33.209800 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushDeltaMemStoresOp(ab7b2ac793a4455e9bbe98795c6a392f) I0516 22:02:33.209775 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.209851 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op LogGCOp(ab7b2ac793a4455e9bbe98795c6a392f) I0516 22:02:33.210012 18347 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.164s (election complete) I0516 22:02:33.210060 18347 raft_consensus.cc:2474] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Leader election decision vote started in defunct term 4: won I0516 22:02:33.210171 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.210207 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.210279 18101 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.210253 18096 raft_consensus.cc:457] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.210635 18096 leader_election.cc:243] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.210767 18094 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.210793 18102 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.980s (starting election) I0516 22:02:33.210852 18094 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.210858 18102 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.211064 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.211155 18094 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.211482 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.211598 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.211724 18094 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.211741 18095 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.211936 18095 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.212040 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.212520 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.212908 18094 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.698s (starting election) I0516 22:02:33.212955 18165 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 5. I0516 22:02:33.212939 18161 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.940s (vote granted) I0516 22:02:33.213016 18094 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.213016 18231 raft_consensus.cc:2219] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 5. I0516 22:02:33.213306 18236 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.790s (vote granted) I0516 22:02:33.213518 18233 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.213654 18233 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Advancing to term 4 I0516 22:02:33.213764 18097 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.213901 18100 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.213593 18164 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.213989 18164 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.214143 18097 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.214838 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.213763 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.215158 18098 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.215741 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.215808 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. I0516 22:02:33.215869 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.216151 18231 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.217227 18236 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 4. I0516 22:02:33.217759 18348 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.200s (election complete) I0516 22:02:33.217842 18161 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 4. I0516 22:02:33.217941 18348 raft_consensus.cc:2474] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won I0516 22:02:33.217944 18093 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.218044 18346 raft_consensus.cc:2016] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Raft consensus shutting down. I0516 22:02:33.218068 18093 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.218250 18289 raft_consensus.cc:2474] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Leader election decision vote started in defunct term 6: won I0516 22:02:33.218264 18101 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.218468 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.218605 18233 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.218768 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.218825 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.218933 18097 raft_consensus.cc:435] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.218996 18097 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.958s (starting election) I0516 22:02:33.219043 18097 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Advancing to term 7 I0516 22:02:33.219164 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.219334 18101 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.219424 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.219449 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.218401 18102 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.219663 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.219715 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. I0516 22:02:33.220481 18164 raft_consensus.cc:2166] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 5 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.220479 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.220629 18323 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.759s (election complete) I0516 22:02:33.221031 18323 raft_consensus.cc:2474] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Leader election decision vote started in defunct term 4: won I0516 22:02:33.221029 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.221155 18102 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.221362 18098 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.222645 18093 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.222647 18162 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 6 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.222751 18162 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.223186 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.223320 18093 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.223783 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.223886 18093 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.224074 18162 raft_consensus.cc:2166] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 6 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.224372 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.224498 18096 leader_election.cc:243] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.224668 18099 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.224715 18099 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.262s (starting election) I0516 22:02:33.224778 18099 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Advancing to term 9 I0516 22:02:33.224891 18346 raft_consensus.cc:2043] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Raft consensus is shut down! I0516 22:02:33.224912 18161 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 6 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.224995 18161 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.225062 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.224522 18094 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.225432 18346 ts_tablet_manager.cc:1369] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Deleting tablet data with delete state TABLET_DATA_DELETED I0516 22:02:33.225613 18094 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.225963 18066 leader_election.cc:393] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 7 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.226101 18231 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.227262 18099 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.227726 18347 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.061s (election complete) I0516 22:02:33.227754 18102 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.227818 18169 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.227943 18169 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.228029 18347 raft_consensus.cc:2474] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Leader election decision vote started in defunct term 3: won I0516 22:02:33.228159 18095 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.228230 18095 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.829s (starting election) I0516 22:02:33.228276 18066 leader_election.cc:270] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. I0516 22:02:33.228303 18095 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.228713 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.229502 18233 raft_consensus.cc:1057] T d744b1d6ab5c4844bd636ab76a6c3bee P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Refusing update from remote peer d7e4c153959b4c86b9dcb5a3441a879a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0516 22:02:33.229738 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.230023 18169 raft_consensus.cc:2166] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 5 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.230024 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.230187 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.230402 18347 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.757s (election complete) I0516 22:02:33.230463 18347 raft_consensus.cc:2459] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority I0516 22:02:33.230540 18165 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 2 FOLLOWER]: Advancing to term 5 I0516 22:02:33.230605 18231 raft_consensus.cc:2166] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 5 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.230610 18162 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 6 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.230720 18162 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.231413 18093 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.231636 18100 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.231710 18100 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.639s (starting election) I0516 22:02:33.231250 18097 raft_consensus.cc:457] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.231835 18100 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.231967 18097 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.232410 18169 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 6 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.232549 18097 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.232573 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.232982 18165 raft_consensus.cc:2166] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 5 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.233146 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.233381 18096 raft_consensus.cc:435] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.233435 18096 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.946s (starting election) I0516 22:02:33.233763 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.233942 18100 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.234068 18162 raft_consensus.cc:2166] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 6 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.234606 18289 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.158s (election complete) I0516 22:02:33.234659 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.234701 18289 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Leader election decision vote started in defunct term 3: won I0516 22:02:33.234696 18163 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.234614 18096 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.234920 18163 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.234982 18095 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.235525 18093 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.235544 18236 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.235703 18236 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.236106 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.236651 18096 raft_consensus.cc:457] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.236930 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.236987 18232 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.237030 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 8 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.237109 18232 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.237145 18235 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.237303 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 6 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.237515 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.237679 18237 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.237772 18237 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.941s (vote granted) I0516 22:02:33.238200 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.238485 18063 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.238543 18063 leader_election.cc:270] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. I0516 22:02:33.239383 18169 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.239459 18169 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.952s (vote granted) I0516 22:02:33.239609 18094 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.237658 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.240159 18237 raft_consensus.cc:2219] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 6. I0516 22:02:33.240402 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.240514 18097 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.240581 18097 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.235s (starting election) I0516 22:02:33.240636 18097 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Advancing to term 7 I0516 22:02:33.240645 18235 raft_consensus.cc:2166] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 8 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.240703 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.240883 18169 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 6. I0516 22:02:33.241266 18161 raft_consensus.cc:2166] T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 6 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.241338 18099 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.241222 18170 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 8 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.241428 18170 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Advancing to term 8 I0516 22:02:33.241451 18099 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.241581 18100 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.241677 18100 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.242018 18163 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.647s (vote granted) I0516 22:02:33.242049 18095 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.242224 18232 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 5 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.242655 18236 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.221s (vote granted) I0516 22:02:33.242653 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.242754 18100 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.243355 18095 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.244176 18236 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 5. I0516 22:02:33.244277 18163 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 5. I0516 22:02:33.244447 18100 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.577s (starting election) I0516 22:02:33.244473 18096 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.244521 18100 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Advancing to term 10 I0516 22:02:33.244586 18096 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.244722 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.244859 18101 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.246043 18346 ts_tablet_manager.cc:1382] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0 I0516 22:02:33.246078 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.246143 18346 log.cc:981] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Deleting WAL directory at /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-0-root/wals/ab7b2ac793a4455e9bbe98795c6a392f I0516 22:02:33.246147 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. I0516 22:02:33.246100 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.246428 18346 ts_tablet_manager.cc:1402] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Deleting consensus metadata I0516 22:02:33.246520 18347 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.005s (election complete) I0516 22:02:33.246601 18347 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Leader election decision vote started in defunct term 4: won I0516 22:02:33.246605 18063 leader_election.cc:393] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 5 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.246898 18170 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.246s (vote granted) I0516 22:02:33.246896 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.247146 18161 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 9 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.247208 18169 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 6 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.247440 18063 leader_election.cc:393] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 6 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.247779 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.248087 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.248380 18170 raft_consensus.cc:2219] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 8. I0516 22:02:33.248585 18169 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.248648 18169 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.239s (vote granted) I0516 22:02:33.248620 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.248745 18093 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.248744 18099 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.248816 18099 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.115s (starting election) I0516 22:02:33.248870 18099 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Advancing to term 7 I0516 22:02:33.249493 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.249649 18095 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.250339 18097 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.250496 18083 tablet_service.cc:801] Processing DeleteTablet for tablet f2d85aa48a984f07a36195498f0f3754 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.250411 18100 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.250600 18102 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.250604 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.250663 18102 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.002s (starting election) I0516 22:02:33.250668 18097 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.250720 18102 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Advancing to term 7 I0516 22:02:33.250746 18100 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.250778 18097 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.250871 18100 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.251377 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.251688 18346 tablet_replica.cc:261] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: stopping tablet replica I0516 22:02:33.251662 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.252271 18102 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.252605 18100 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.252607 18289 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.735s (election complete) I0516 22:02:33.252637 18162 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 6 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.252777 18162 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.252759 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 5 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.253582 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 8 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.253703 18094 raft_consensus.cc:435] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.253753 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 2 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.253890 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.254019 18165 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Advancing to term 8 I0516 22:02:33.254070 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 5 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.254283 18098 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.254565 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.254848 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 3 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 3 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.255067 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.255349 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.255411 18164 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 7 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.255491 18094 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.113s (starting election) I0516 22:02:33.256124 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 10 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.256888 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 6 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.256976 18161 raft_consensus.cc:2194] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.258216 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 6 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.258380 18169 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 6. I0516 22:02:33.258400 18099 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.258735 18163 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 7 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.258754 18232 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 6 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.259016 18232 raft_consensus.cc:2756] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.259068 18099 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.259064 18063 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.259171 18063 leader_election.cc:270] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. I0516 22:02:33.259255 18099 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.259467 18232 raft_consensus.cc:2704] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.601s (vote granted) I0516 22:02:33.259531 18063 leader_election.cc:393] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T ab7b2ac793a4455e9bbe98795c6a392f P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 6 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.259892 18169 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 7 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.260051 18169 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Advancing to term 7 I0516 22:02:33.260113 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.260288 18165 raft_consensus.cc:2166] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 8 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.260452 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.261026 18232 raft_consensus.cc:2219] T ab7b2ac793a4455e9bbe98795c6a392f P b141e05cb0444865b490089e568edadc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 6. I0516 22:02:33.261186 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op CompactRowSetsOp(f2d85aa48a984f07a36195498f0f3754) I0516 22:02:33.261189 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.261263 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MinorDeltaCompactionOp(f2d85aa48a984f07a36195498f0f3754) I0516 22:02:33.261289 18096 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.261328 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MajorDeltaCompactionOp(f2d85aa48a984f07a36195498f0f3754) I0516 22:02:33.261102 18169 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.898s (vote granted) I0516 22:02:33.261358 18096 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.489s (starting election) I0516 22:02:33.261384 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op UndoDeltaBlockGCOp(f2d85aa48a984f07a36195498f0f3754) I0516 22:02:33.261409 18096 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Advancing to term 11 I0516 22:02:33.261443 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushMRSOp(f2d85aa48a984f07a36195498f0f3754) I0516 22:02:33.261479 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushDeltaMemStoresOp(f2d85aa48a984f07a36195498f0f3754) I0516 22:02:33.261533 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op LogGCOp(f2d85aa48a984f07a36195498f0f3754) I0516 22:02:33.262676 18169 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 7. I0516 22:02:33.262723 18096 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.262912 18232 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 7 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.263002 18096 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.263029 18232 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 5 FOLLOWER]: Advancing to term 7 I0516 22:02:33.263077 18232 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.086s (vote granted) I0516 22:02:33.263131 18096 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.263283 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. I0516 22:02:33.263681 18102 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.263679 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.263722 18063 leader_election.cc:379] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.263780 18063 leader_election.cc:270] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. I0516 22:02:33.263795 18102 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.263911 18323 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.852s (election complete) I0516 22:02:33.264014 18163 raft_consensus.cc:2194] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 7 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.263998 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.264006 18289 raft_consensus.cc:2474] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Leader election decision vote started in defunct term 5: won I0516 22:02:33.264991 18100 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.265043 18236 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.265137 18101 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.265192 18236 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Advancing to term 5 I0516 22:02:33.265283 18095 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.182s (starting election) I0516 22:02:33.265290 18236 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.068s (vote granted) I0516 22:02:33.265369 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 7 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.265496 18237 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 6 FOLLOWER]: Advancing to term 7 I0516 22:02:33.265609 18094 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Advancing to term 9 I0516 22:02:33.265609 18237 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.930s (vote granted) I0516 22:02:33.265784 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.266582 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 7 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.266671 18095 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 6 FOLLOWER]: Advancing to term 7 I0516 22:02:33.266847 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.266907 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. I0516 22:02:33.267319 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.267792 18232 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 7. I0516 22:02:33.268070 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.268636 18236 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 5. I0516 22:02:33.268972 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.269064 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.269765 18228 raft_consensus.cc:1057] T fde57a2e13af4bcc9077306cd4109c3e P b141e05cb0444865b490089e568edadc [term 1 FOLLOWER]: Refusing update from remote peer d7e4c153959b4c86b9dcb5a3441a879a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0516 22:02:33.269839 18237 raft_consensus.cc:2219] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 7. I0516 22:02:33.269881 18066 leader_election.cc:379] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.269637 18229 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 8 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.269492 18230 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 6 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.269999 18094 raft_consensus.cc:457] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.270190 18229 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.270275 18346 raft_consensus.cc:2016] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Raft consensus shutting down. I0516 22:02:33.270263 18230 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.270432 18235 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 5 FOLLOWER]: Advancing to term 6 I0516 22:02:33.270563 18066 leader_election.cc:270] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. I0516 22:02:33.270583 18230 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.888s (vote granted) I0516 22:02:33.271172 18162 raft_consensus.cc:2166] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 6 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.269557 18232 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 10 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.271445 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.271661 18093 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.272485 18228 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 7 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.272701 18230 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 6. I0516 22:02:33.272742 18323 raft_consensus.cc:2474] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Leader election decision vote started in defunct term 8: won I0516 22:02:33.272804 18235 raft_consensus.cc:2166] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 6 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.272889 18096 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.272938 18096 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.793s (starting election) I0516 22:02:33.273023 18232 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Advancing to term 10 I0516 22:02:33.273041 18096 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Advancing to term 12 I0516 22:02:33.273072 18066 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.273144 18066 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. I0516 22:02:33.273586 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 4 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.273758 18095 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.274168 18063 leader_election.cc:393] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.274173 18163 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 11 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.274256 18095 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.274329 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.274528 18289 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.110s (election complete) I0516 22:02:33.274528 18164 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Advancing to term 7 I0516 22:02:33.274606 18233 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 9 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.274816 18231 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 6 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.274935 18231 raft_consensus.cc:2124] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for earlier term 6. Current term is 7. I0516 22:02:33.274899 18096 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.275477 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.275619 18097 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.275691 18234 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 6 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.276049 18098 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.276154 18066 leader_election.cc:393] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 5 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.276360 18165 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Advancing to term 7 I0516 22:02:33.276443 18165 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.800s (vote granted) I0516 22:02:33.276443 18229 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.999s (vote granted) I0516 22:02:33.276721 18094 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.276835 18094 leader_election.cc:243] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.276954 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.277207 18232 raft_consensus.cc:2166] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 10 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.277209 18346 raft_consensus.cc:2043] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Raft consensus is shut down! I0516 22:02:33.277253 18164 raft_consensus.cc:2166] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 7 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.277287 18233 raft_consensus.cc:2194] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.277369 18167 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Advancing to term 10 I0516 22:02:33.277431 18167 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.897s (vote granted) I0516 22:02:33.277846 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.278254 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.278488 18099 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.278527 18349 raft_consensus.cc:2428] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Received election callback for term 5 while not running: Illegal state: RaftConsensus is not running: State = Stopped I0516 22:02:33.278565 18099 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.811s (starting election) I0516 22:02:33.278561 18093 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.795s (starting election) I0516 22:02:33.278651 18099 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.279219 18346 ts_tablet_manager.cc:1369] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting tablet data with delete state TABLET_DATA_DELETED I0516 22:02:33.278565 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 11 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.279608 18237 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 10 FOLLOWER]: Advancing to term 11 I0516 22:02:33.279670 18230 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 7 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.279819 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.279804 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.280369 18093 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.280702 18347 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.082s (election complete) I0516 22:02:33.280761 18347 raft_consensus.cc:2474] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won I0516 22:02:33.281049 18102 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.281322 18230 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 6 FOLLOWER]: Advancing to term 7 I0516 22:02:33.281813 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. I0516 22:02:33.281831 18095 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.281827 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.281976 18289 raft_consensus.cc:2474] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Leader election decision vote started in defunct term 4: won I0516 22:02:33.282095 18229 raft_consensus.cc:2219] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 8. I0516 22:02:33.282299 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.282783 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.283991 18099 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.284628 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. I0516 22:02:33.285240 18164 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 7 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.285969 18164 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Advancing to term 7 I0516 22:02:33.286049 18162 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 9 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.287948 18063 leader_election.cc:393] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 8 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.288151 18066 leader_election.cc:379] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.288203 18066 leader_election.cc:270] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. I0516 22:02:33.288173 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.288271 18094 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader W0516 22:02:33.288311 18066 raft_consensus.cc:2415] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Unable to run election callback: Service unavailable: Thread pool token was shut down I0516 22:02:33.288498 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.288522 18228 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 5 FOLLOWER]: Advancing to term 7 I0516 22:02:33.288697 18167 raft_consensus.cc:2219] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 10. I0516 22:02:33.288871 18163 raft_consensus.cc:2194] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 11 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.289053 18066 leader_election.cc:393] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 8 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.289465 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.289844 18233 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 7 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.289947 18233 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 6 FOLLOWER]: Advancing to term 7 I0516 22:02:33.288691 18351 consensus_queue.cc:963] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s I0516 22:02:33.290199 18233 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.813s (vote granted) I0516 22:02:33.290278 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.290472 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.290871 18165 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 7. I0516 22:02:33.290920 18237 raft_consensus.cc:2166] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 11 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.291098 18228 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 7 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.291241 18234 raft_consensus.cc:2194] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 6 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.291239 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.291479 18099 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.291498 18348 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.947s (election complete) I0516 22:02:33.291558 18348 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Leader election decision vote started in defunct term 5: won I0516 22:02:33.291590 18099 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.291728 18347 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.022s (election complete) I0516 22:02:33.291779 18347 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Leader election decision vote started in defunct term 6: won I0516 22:02:33.291857 18289 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.973s (election complete) I0516 22:02:33.291919 18289 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won I0516 22:02:33.292443 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.292524 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.292757 18233 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 7. I0516 22:02:33.292832 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.293025 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.293136 18164 raft_consensus.cc:2166] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 7 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.293238 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.293196 18093 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.293175 18162 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Advancing to term 9 I0516 22:02:33.293349 18099 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.293393 18099 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.616s (starting election) I0516 22:02:33.293123 18346 ts_tablet_manager.cc:1382] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0 I0516 22:02:33.293457 18230 raft_consensus.cc:2166] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 7 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.293493 18346 log.cc:981] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting WAL directory at /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-0-root/wals/f2d85aa48a984f07a36195498f0f3754 I0516 22:02:33.293684 18323 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.729s (election complete) I0516 22:02:33.293139 18097 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.293897 18102 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.677s (starting election) I0516 22:02:33.293946 18102 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.293917 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.293975 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.294070 18323 raft_consensus.cc:2474] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Leader election decision vote started in defunct term 4: won I0516 22:02:33.294189 18093 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.294991 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.295430 18162 raft_consensus.cc:2166] T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.296214 18093 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.296272 18096 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.296387 18096 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.296602 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.296597 18229 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 9 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.296713 18229 raft_consensus.cc:2756] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Advancing to term 9 I0516 22:02:33.296710 18098 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.296866 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.296941 18229 raft_consensus.cc:2704] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.997s (vote granted) I0516 22:02:33.297045 18094 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.297052 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.297049 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.297174 18346 ts_tablet_manager.cc:1402] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting consensus metadata I0516 22:02:33.297319 18093 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.297369 18093 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 5.009s (starting election) I0516 22:02:33.297789 18096 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.297796 18093 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Advancing to term 13 I0516 22:02:33.299032 18229 raft_consensus.cc:2219] T f2d85aa48a984f07a36195498f0f3754 P b141e05cb0444865b490089e568edadc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 9. I0516 22:02:33.299111 18093 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.299310 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.299414 18093 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.299440 18100 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.299505 18093 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.299552 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 5 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.299907 18066 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.299981 18066 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. I0516 22:02:33.300139 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.300287 18093 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.300248 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.300403 18100 raft_consensus.cc:435] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.300489 18100 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 4.275s (starting election) I0516 22:02:33.300540 18100 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Advancing to term 14 I0516 22:02:33.300709 18230 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 8 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.300846 18230 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.300900 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.301093 18102 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.301683 18102 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.301834 18098 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.509s (starting election) I0516 22:02:33.301895 18098 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.302114 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.302388 18228 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 13 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.302489 18228 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 11 FOLLOWER]: Advancing to term 13 I0516 22:02:33.302713 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 W0516 22:02:33.302796 18063 leader_election.cc:363] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) with higher term. Message: Service unavailable: T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 7 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.302839 18063 leader_election.cc:366] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term I0516 22:02:33.301445 18099 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Advancing to term 9 W0516 22:02:33.303133 18063 raft_consensus.cc:2415] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Unable to run election callback: Service unavailable: Thread pool token was shut down I0516 22:02:33.303158 18083 tablet_service.cc:801] Processing DeleteTablet for tablet 00efb34f943d4fa88ec6dcd181ee5c96 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.303475 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.303560 18093 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.303647 18346 tablet_replica.cc:261] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: stopping tablet replica I0516 22:02:33.304205 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.304607 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.304832 18066 leader_election.cc:379] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.304903 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 6 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.305361 18164 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 8 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.305428 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.306540 18102 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.306567 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 12 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.306566 18234 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 12 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.306870 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 8 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.307428 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.308120 18099 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.308867 18230 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 8 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.309370 18165 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Advancing to term 12 I0516 22:02:33.309391 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.309442 18165 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.013s (vote granted) I0516 22:02:33.309494 18094 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.309736 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.309945 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op CompactRowSetsOp(00efb34f943d4fa88ec6dcd181ee5c96) I0516 22:02:33.310009 18096 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.160s (starting election) I0516 22:02:33.310111 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MinorDeltaCompactionOp(00efb34f943d4fa88ec6dcd181ee5c96) I0516 22:02:33.310185 18233 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 8 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.310310 18233 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.310288 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.310416 18233 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.152s (vote granted) I0516 22:02:33.310672 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.310868 18096 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Advancing to term 9 I0516 22:02:33.311306 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.311903 18233 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 8. I0516 22:02:33.311918 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.312556 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.312500 18096 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.312826 18323 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.005s (election complete) I0516 22:02:33.312888 18323 raft_consensus.cc:2474] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Leader election decision vote started in defunct term 5: won I0516 22:02:33.313012 18096 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.313169 18096 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.313189 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.313357 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 7 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.313575 18063 leader_election.cc:379] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.313635 18063 leader_election.cc:270] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. I0516 22:02:33.313908 18063 leader_election.cc:393] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 11 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.313850 18162 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 8 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.314151 18063 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.314134 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.314191 18063 leader_election.cc:270] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. I0516 22:02:33.314478 18162 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.314412 18094 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.314599 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 7 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.314743 18063 leader_election.cc:393] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f2d85aa48a984f07a36195498f0f3754 P d2767dd0c676459aa9c2533260fc9d46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.314810 18169 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 9 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.314980 18094 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.740s (starting election) I0516 22:02:33.315047 18094 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Advancing to term 10 I0516 22:02:33.315241 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.316313 18094 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.316614 18165 raft_consensus.cc:2219] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 12. I0516 22:02:33.316680 18167 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.316650 18163 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 13 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.316756 18167 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.801s (vote granted) I0516 22:02:33.316774 18163 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 12 FOLLOWER]: Advancing to term 13 I0516 22:02:33.316846 18163 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.536s (vote granted) I0516 22:02:33.316969 18102 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.317023 18102 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.840s (starting election) I0516 22:02:33.317090 18102 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Advancing to term 9 I0516 22:02:33.318317 18163 raft_consensus.cc:2219] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 13. I0516 22:02:33.318372 18167 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 8. I0516 22:02:33.318449 18102 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.318730 18102 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.318748 18289 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.587s (election complete) I0516 22:02:33.318812 18289 raft_consensus.cc:2474] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Leader election decision vote started in defunct term 7: won I0516 22:02:33.318845 18102 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.318980 18228 raft_consensus.cc:2166] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 13 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.319000 18099 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.319036 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MajorDeltaCompactionOp(00efb34f943d4fa88ec6dcd181ee5c96) I0516 22:02:33.319110 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op UndoDeltaBlockGCOp(00efb34f943d4fa88ec6dcd181ee5c96) I0516 22:02:33.319108 18099 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.319175 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushMRSOp(00efb34f943d4fa88ec6dcd181ee5c96) I0516 22:02:33.319231 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushDeltaMemStoresOp(00efb34f943d4fa88ec6dcd181ee5c96) I0516 22:02:33.319273 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op LogGCOp(00efb34f943d4fa88ec6dcd181ee5c96) I0516 22:02:33.319319 18234 raft_consensus.cc:2194] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 12 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.319526 18101 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.319602 18100 raft_consensus.cc:457] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.319799 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.319851 18100 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.319924 18101 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.319965 18101 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.107s (starting election) I0516 22:02:33.320039 18323 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 4.569s (election complete) I0516 22:02:33.320168 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.320206 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.320294 18099 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.320313 18162 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.218s (vote granted) I0516 22:02:33.320420 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.320551 18101 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Advancing to term 10 I0516 22:02:33.321084 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.320291 18098 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.321566 18102 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.322417 18162 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 8. I0516 22:02:33.322551 18098 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.322649 18099 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.038s (starting election) I0516 22:02:33.322700 18099 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Advancing to term 10 I0516 22:02:33.322631 18101 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.323488 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.323595 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.323791 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.323868 18093 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.323964 18063 leader_election.cc:379] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.324012 18063 leader_election.cc:270] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. I0516 22:02:33.324123 18099 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.324350 18063 leader_election.cc:379] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.324398 18063 leader_election.cc:270] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. I0516 22:02:33.324393 18099 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.324506 18099 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.324499 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.324753 18063 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.324826 18063 leader_election.cc:270] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. I0516 22:02:33.324901 18164 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.325120 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.325176 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. I0516 22:02:33.325181 18161 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 10 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.325129 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 8 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.324759 18095 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.325306 18161 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Advancing to term 10 I0516 22:02:33.325356 18348 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.627s (election complete) I0516 22:02:33.325448 18066 leader_election.cc:270] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. I0516 22:02:33.325444 18161 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.034s (vote granted) I0516 22:02:33.325441 18351 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.995s (election complete) I0516 22:02:33.325505 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 9 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.325742 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.325824 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.326189 18348 raft_consensus.cc:2474] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Leader election decision vote started in defunct term 8: won I0516 22:02:33.326781 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.326866 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.326916 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 W0516 22:02:33.327059 18066 raft_consensus.cc:2415] T ab7b2ac793a4455e9bbe98795c6a392f P d7e4c153959b4c86b9dcb5a3441a879a: Unable to run election callback: Service unavailable: Thread pool token was shut down I0516 22:02:33.327848 18098 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.328035 18165 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.328047 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.328052 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.328426 18094 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.328559 18094 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.328567 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.329059 18162 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 9 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.329279 18164 raft_consensus.cc:2166] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 8 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.329296 18102 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.329394 18170 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 10 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.329421 18163 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 14 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.329594 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.329834 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 8 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.329840 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.330001 18093 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.330152 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.330250 18095 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.330301 18163 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Advancing to term 14 I0516 22:02:33.330340 18102 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.097s (starting election) I0516 22:02:33.330338 18095 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.570s (starting election) I0516 22:02:33.330488 18095 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Advancing to term 11 I0516 22:02:33.330518 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.330395 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.330494 18163 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.852s (vote granted) I0516 22:02:33.330971 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.331058 18093 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.331092 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.332201 18098 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.332275 18098 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.859s (starting election) I0516 22:02:33.332952 18165 raft_consensus.cc:2166] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 8 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.333240 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 8 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.333395 18163 raft_consensus.cc:2219] T 00efb34f943d4fa88ec6dcd181ee5c96 P d2767dd0c676459aa9c2533260fc9d46 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 14. I0516 22:02:33.333544 18066 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.333565 18101 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.333603 18066 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. I0516 22:02:33.333643 18063 leader_election.cc:379] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.333699 18063 leader_election.cc:270] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. I0516 22:02:33.333705 18101 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.333837 18323 raft_consensus.cc:2474] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Leader election decision vote started in defunct term 10: won I0516 22:02:33.333909 18349 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 5.027s (election complete) I0516 22:02:33.333964 18349 raft_consensus.cc:2511] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Leader election won for term 14 I0516 22:02:33.334110 18100 leader_election.cc:243] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.334395 18163 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 10 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.334496 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.334846 18167 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Advancing to term 9 I0516 22:02:33.334822 18234 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 8 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.335094 18167 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.082s (vote granted) I0516 22:02:33.335098 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.335096 18234 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.335258 18228 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 9 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.335597 18233 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 9 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.336760 18233 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Advancing to term 9 I0516 22:02:33.337651 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.337852 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.339143 18161 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 10. I0516 22:02:33.339397 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.339467 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.339673 18162 raft_consensus.cc:2194] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.340301 18094 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.340503 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.340535 18095 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.340812 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.340839 18095 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.340888 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.340956 18101 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.341063 18098 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Advancing to term 11 I0516 22:02:33.341153 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.341845 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.342370 18098 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.342718 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.342818 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. I0516 22:02:33.342849 18228 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Advancing to term 9 I0516 22:02:33.342751 18351 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Leader election decision vote started in defunct term 8: won I0516 22:02:33.342969 18100 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.343019 18100 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.144s (starting election) I0516 22:02:33.342815 18230 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 10 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.343096 18100 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Advancing to term 11 I0516 22:02:33.343190 18228 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.509s (vote granted) I0516 22:02:33.343425 18237 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 8 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.343775 18229 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 9 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.344142 18102 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 8 FOLLOWER]: Advancing to term 9 I0516 22:02:33.344559 18099 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.344658 18167 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 9. I0516 22:02:33.344594 18349 raft_consensus.cc:571] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 LEADER]: Becoming Leader. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Running, Role: LEADER I0516 22:02:33.344969 18234 raft_consensus.cc:2166] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 8 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.345041 18349 consensus_queue.cc:204] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.345362 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.345417 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.346081 18230 raft_consensus.cc:2194] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 10 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.346143 18163 raft_consensus.cc:2194] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 10 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.348649 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.348677 18289 raft_consensus.cc:2704] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.761s (election complete) I0516 22:02:33.349426 18229 raft_consensus.cc:2194] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.349514 18233 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.349530 18063 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.348358 18100 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.349594 18063 leader_election.cc:270] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. I0516 22:02:33.349845 18099 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.349998 18100 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.350101 18100 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.350538 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.350642 18100 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.350958 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.351213 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.351217 18102 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.351424 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.351208 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.351581 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.351599 18101 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.351660 18348 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.589s (election complete) I0516 22:02:33.351748 18348 raft_consensus.cc:2474] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Leader election decision vote started in defunct term 7: won I0516 22:02:33.351773 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.351822 18096 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.351986 18237 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Advancing to term 8 I0516 22:02:33.352044 18237 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.653s (vote granted) I0516 22:02:33.352180 18099 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.352217 18351 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.813s (election complete) I0516 22:02:33.352285 18066 leader_election.cc:379] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.352677 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.352746 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.352775 18101 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.353109 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. I0516 22:02:33.353544 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.353664 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.353814 18099 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.009s (starting election) I0516 22:02:33.353883 18289 raft_consensus.cc:2474] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 LEADER]: Leader election decision vote started in defunct term 12: won I0516 22:02:33.353946 18346 raft_consensus.cc:2016] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 LEADER]: Raft consensus shutting down. I0516 22:02:33.354035 18101 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.354157 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.354450 18346 consensus_peers.cc:456] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a -> Peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899): Closing peer: b141e05cb0444865b490089e568edadc I0516 22:02:33.354519 18346 consensus_peers.cc:456] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a -> Peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101): Closing peer: d2767dd0c676459aa9c2533260fc9d46 I0516 22:02:33.354682 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.354732 18066 leader_election.cc:393] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 6 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.355020 18169 raft_consensus.cc:2194] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.355248 18170 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Advancing to term 10 I0516 22:02:33.355820 18095 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.355864 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.356075 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.356348 18098 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.356391 18102 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.356428 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.356477 18098 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.356515 18102 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.356683 18232 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 10 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.356703 18231 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 10 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.356807 18231 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 9 FOLLOWER]: Advancing to term 10 I0516 22:02:33.357081 18170 raft_consensus.cc:2166] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 10 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.357257 18349 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.051s (election complete) I0516 22:02:33.357311 18349 raft_consensus.cc:2474] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won I0516 22:02:33.357319 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.357592 18096 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.357620 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 14 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.357841 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.357919 18235 raft_consensus.cc:2756] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 13 FOLLOWER]: Advancing to term 14 I0516 22:02:33.358211 18351 raft_consensus.cc:2474] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Leader election decision vote started in defunct term 5: won I0516 22:02:33.357659 18348 consensus_queue.cc:963] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s I0516 22:02:33.358852 18228 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 9. I0516 22:02:33.359239 18232 raft_consensus.cc:2194] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 10 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.359166 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.359482 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.359647 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.359761 18096 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.632s (starting election) I0516 22:02:33.359827 18096 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Advancing to term 12 I0516 22:02:33.360469 18235 raft_consensus.cc:2166] T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 14 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.361161 18096 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.361462 18096 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.361562 18096 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.361685 18099 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Advancing to term 12 I0516 22:02:33.361723 18347 raft_consensus.cc:2428] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 LEADER]: Received election callback for term 13 while not running: Illegal state: RaftConsensus is not running: State = Stopping I0516 22:02:33.361793 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.362051 18346 pending_rounds.cc:63] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Trying to abort 1 pending transactions. W0516 22:02:33.362076 18066 leader_election.cc:363] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) with higher term. Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for earlier term 6. Current term is 7. I0516 22:02:33.362120 18066 leader_election.cc:366] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term I0516 22:02:33.362095 18346 pending_rounds.cc:68] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Aborting transaction as it isn't in flight: id { term: 14 index: 1 } timestamp: 6252577396103647232 op_type: NO_OP noop_request { } I0516 22:02:33.362200 18346 raft_consensus.cc:2594] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0516 22:02:33.362251 18346 raft_consensus.cc:2043] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Raft consensus is shut down! I0516 22:02:33.362387 18347 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.099s (election complete) I0516 22:02:33.362450 18347 raft_consensus.cc:2459] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) with higher term. Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for earlier term 6. Current term is 7. I0516 22:02:33.362519 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.362603 18094 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.362934 18066 leader_election.cc:393] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 10 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.363179 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.363263 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.363302 18102 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.363353 18102 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.718s (starting election) I0516 22:02:33.363397 18102 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Advancing to term 12 I0516 22:02:33.363538 18232 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 11 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.363662 18232 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 9 FOLLOWER]: Advancing to term 11 I0516 22:02:33.363728 18232 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.569s (vote granted) I0516 22:02:33.364042 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 W0516 22:02:33.364537 18066 leader_election.cc:363] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) with higher term. Message: Service unavailable: T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.364518 18228 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 9 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.364523 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 11 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.367902 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.368616 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.369402 18099 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.369678 18229 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 11 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.369776 18231 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 10 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.369771 18099 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.369854 18229 raft_consensus.cc:2194] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 11 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.370031 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 W0516 22:02:33.370065 18063 leader_election.cc:363] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) with higher term. Message: Service unavailable: T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.370112 18237 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 8. I0516 22:02:33.370141 18100 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.370146 18063 leader_election.cc:366] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term I0516 22:02:33.370268 18346 ts_tablet_manager.cc:1369] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting tablet data with delete state TABLET_DATA_DELETED I0516 22:02:33.370359 18228 raft_consensus.cc:2194] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.370630 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.370682 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. I0516 22:02:33.369289 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.371054 18230 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 12 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.371788 18066 leader_election.cc:366] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term W0516 22:02:33.371893 18066 raft_consensus.cc:2415] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Unable to run election callback: Service unavailable: Thread pool token was shut down I0516 22:02:33.372349 18066 leader_election.cc:379] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.372350 18169 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 11 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.372407 18066 leader_election.cc:270] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. I0516 22:02:33.372858 18169 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 9 FOLLOWER]: Advancing to term 11 I0516 22:02:33.371947 18170 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 11 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.372944 18347 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.247s (election complete) I0516 22:02:33.369976 18353 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.183s (election complete) I0516 22:02:33.373131 18169 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.779s (vote granted) I0516 22:02:33.373155 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.373693 18351 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.526s (election complete) I0516 22:02:33.373976 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.374061 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 9 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.373997 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.374094 18093 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.374501 18167 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Advancing to term 9 I0516 22:02:33.374667 18353 raft_consensus.cc:2474] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Leader election decision vote started in defunct term 6: won I0516 22:02:33.374774 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.374800 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.375181 18099 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.375278 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.375535 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.376093 18095 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.376241 18098 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Starting forced leader election (received explicit request) W0516 22:02:33.376274 18066 raft_consensus.cc:2415] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Unable to run election callback: Service unavailable: Thread pool token was shut down I0516 22:02:33.376772 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.376803 18098 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.180s (starting election) I0516 22:02:33.376863 18098 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 9 FOLLOWER]: Advancing to term 10 I0516 22:02:33.377183 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.377663 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.377694 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.378125 18170 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Advancing to term 11 I0516 22:02:33.378204 18170 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.855s (vote granted) I0516 22:02:33.378492 18066 leader_election.cc:393] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 11 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.378700 18347 raft_consensus.cc:2459] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) with higher term. Message: Service unavailable: T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.379228 18094 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.378845 18018 catalog_manager.cc:3686] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a reported cstate change: term changed from 1 to 14, leader changed from b141e05cb0444865b490089e568edadc (127.17.88.3) to d7e4c153959b4c86b9dcb5a3441a879a (127.17.88.1). New cstate: current_term: 14 leader_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } } W0516 22:02:33.379420 18018 quorum_util.cc:577] leader peer d7e4c153959b4c86b9dcb5a3441a879a reported health as UNKNOWN; config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } F0516 22:02:33.379554 18018 quorum_util.cc:582] Check failed: false Found non-HEALTHY LEADER *** Check failure stack trace: *** I0516 22:02:33.379564 18232 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 11. I0516 22:02:33.380568 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.382356 18167 raft_consensus.cc:2166] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.382493 18162 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 12 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.383298 18102 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.383595 18063 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 10 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.383798 18102 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.383850 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.383983 18351 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Leader election decision vote started in defunct term 9: won I0516 22:02:33.384097 18102 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.384399 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 12 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.384891 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 10 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.385360 18161 raft_consensus.cc:1057] T d744b1d6ab5c4844bd636ab76a6c3bee P d2767dd0c676459aa9c2533260fc9d46 [term 1 FOLLOWER]: Refusing update from remote peer d7e4c153959b4c86b9dcb5a3441a879a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0516 22:02:33.385349 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.385499 18100 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.385582 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 12 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.385684 18165 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Advancing to term 12 I0516 22:02:33.385455 18101 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.385181 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.385957 18094 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 4.304s (starting election) I0516 22:02:33.386018 18094 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Advancing to term 13 I0516 22:02:33.386165 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.386276 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.386555 18351 consensus_queue.cc:963] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0516 22:02:33.386704 18346 ts_tablet_manager.cc:1382] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 14.1 I0516 22:02:33.387328 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.387722 18096 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.387800 18096 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.656s (starting election) I0516 22:02:33.387773 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.388293 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.387989 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.389444 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.390075 18170 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 11. I0516 22:02:33.390218 18162 raft_consensus.cc:2194] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 12 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.390718 18063 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.390822 18094 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.390969 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.391211 18063 leader_election.cc:270] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. I0516 22:02:33.391237 18066 leader_election.cc:270] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. I0516 22:02:33.391350 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 W0516 22:02:33.391381 18066 raft_consensus.cc:2415] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Unable to run election callback: Service unavailable: Thread pool token was shut down I0516 22:02:33.391508 18100 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.821s (starting election) I0516 22:02:33.391562 18100 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Advancing to term 13 I0516 22:02:33.392232 18094 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.392240 18169 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 11. I0516 22:02:33.392720 18167 raft_consensus.cc:2194] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 12 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.392724 18094 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.392946 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.393049 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.393198 18096 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Advancing to term 13 I0516 22:02:33.393632 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.393810 18233 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 12 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.394055 18163 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 11 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.394367 18235 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Advancing to term 11 I0516 22:02:33.394449 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.394739 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.395453 18096 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } @ 0x7ff0a857962d google::LogMessage::Fail() at ??:0 I0516 22:02:33.396348 18235 raft_consensus.cc:2166] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 11 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.396456 18230 raft_consensus.cc:2194] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 12 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.396589 18165 raft_consensus.cc:2166] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 12 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.396802 18163 raft_consensus.cc:2194] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 11 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.397192 18063 leader_election.cc:393] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 12 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.397394 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 7 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.397471 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.397625 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.397884 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.397929 18346 log.cc:981] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting WAL directory at /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-0-root/wals/00efb34f943d4fa88ec6dcd181ee5c96 I0516 22:02:33.397961 18099 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.397807 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.398172 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.398257 18101 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.398366 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.398577 18346 ts_tablet_manager.cc:1402] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting consensus metadata I0516 22:02:33.399050 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.399164 18093 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader W0516 22:02:33.399266 18066 leader_election.cc:363] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 6 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) with higher term. Message: Service unavailable: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 6 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.399554 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.399617 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. I0516 22:02:33.399613 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.399658 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 13 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.399760 18235 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 11 FOLLOWER]: Advancing to term 13 I0516 22:02:33.399816 18096 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.399893 18066 leader_election.cc:393] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 7 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 7 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.399912 18096 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.400105 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.400259 18100 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.400429 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.400630 18066 leader_election.cc:379] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.400663 18100 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.400748 18066 leader_election.cc:270] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. I0516 22:02:33.400818 18100 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.401105 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.401283 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.401793 18083 tablet_service.cc:801] Processing DeleteTablet for tablet fde57a2e13af4bcc9077306cd4109c3e with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:45694 W0516 22:02:33.402572 18066 raft_consensus.cc:2415] T f2d85aa48a984f07a36195498f0f3754 P d7e4c153959b4c86b9dcb5a3441a879a: Unable to run election callback: Service unavailable: Thread pool token was shut down I0516 22:02:33.403066 18098 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.403367 18347 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.646s (election complete) I0516 22:02:33.403378 18098 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.403709 18233 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 10 FOLLOWER]: Advancing to term 12 I0516 22:02:33.403736 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. I0516 22:02:33.403733 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.404228 18353 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.620s (election complete) I0516 22:02:33.404353 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.404498 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.404625 18102 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.404702 18102 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.564s (starting election) I0516 22:02:33.404739 18353 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Leader election decision vote started in defunct term 11: won I0516 22:02:33.404789 18063 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 12 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.404884 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.405227 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 13 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.405381 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.405514 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.405598 18346 tablet_replica.cc:261] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: stopping tablet replica I0516 22:02:33.405691 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op CompactRowSetsOp(fde57a2e13af4bcc9077306cd4109c3e) I0516 22:02:33.405807 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MinorDeltaCompactionOp(fde57a2e13af4bcc9077306cd4109c3e) I0516 22:02:33.405779 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.405937 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.406038 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 8 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.406199 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MajorDeltaCompactionOp(fde57a2e13af4bcc9077306cd4109c3e) I0516 22:02:33.406245 18099 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.406335 18347 raft_consensus.cc:2474] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Leader election decision vote started in defunct term 7: won I0516 22:02:33.406338 18066 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.406487 18066 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. I0516 22:02:33.406462 18232 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 13 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.406574 18232 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 11 FOLLOWER]: Advancing to term 13 I0516 22:02:33.406555 18228 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 13 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.406631 18232 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.217s (vote granted) I0516 22:02:33.406814 18066 leader_election.cc:393] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 13 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. W0516 22:02:33.407033 18066 leader_election.cc:363] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) with higher term. Message: Service unavailable: T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 12 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.407142 18233 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 12 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.407208 18066 leader_election.cc:393] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 8 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.407425 18098 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.407610 18228 raft_consensus.cc:2194] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 13 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.407642 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.407729 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.407919 18066 leader_election.cc:393] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 10 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.408040 18232 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 13. I0516 22:02:33.408174 18163 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 13 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.408347 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.408401 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.408485 18163 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 11 FOLLOWER]: Advancing to term 13 I0516 22:02:33.408593 18163 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.522s (vote granted) I0516 22:02:33.408998 18102 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Advancing to term 14 I0516 22:02:33.408974 18232 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 10 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.409087 18232 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Advancing to term 10 I0516 22:02:33.409348 18232 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.653s (vote granted) I0516 22:02:33.409795 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.410152 18161 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 13 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.410204 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.410346 18165 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 11 FOLLOWER]: Advancing to term 13 I0516 22:02:33.410409 18165 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.028s (vote granted) I0516 22:02:33.410490 18161 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 12 FOLLOWER]: Advancing to term 13 I0516 22:02:33.410651 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.410768 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.411274 18235 raft_consensus.cc:2166] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 13 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.411581 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op UndoDeltaBlockGCOp(fde57a2e13af4bcc9077306cd4109c3e) I0516 22:02:33.411583 18163 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 13. I0516 22:02:33.411581 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.411662 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushMRSOp(fde57a2e13af4bcc9077306cd4109c3e) I0516 22:02:33.412017 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushDeltaMemStoresOp(fde57a2e13af4bcc9077306cd4109c3e) I0516 22:02:33.412046 18351 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 4.598s (election complete) I0516 22:02:33.412076 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op LogGCOp(fde57a2e13af4bcc9077306cd4109c3e) I0516 22:02:33.412284 18351 raft_consensus.cc:2474] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Leader election decision vote started in defunct term 11: won I0516 22:02:33.412302 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.412662 18096 raft_consensus.cc:418] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.412689 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.412992 18346 raft_consensus.cc:2016] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Raft consensus shutting down. I0516 22:02:33.413113 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.413350 18094 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.413524 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 12 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.413600 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 W0516 22:02:33.413702 18063 leader_election.cc:363] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) with higher term. Message: Service unavailable: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 11 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.413878 18063 leader_election.cc:366] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term I0516 22:02:33.414002 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.414105 18063 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.414139 18346 consensus_peers.cc:456] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a -> Peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899): Closing peer: b141e05cb0444865b490089e568edadc I0516 22:02:33.414378 18063 leader_election.cc:270] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. I0516 22:02:33.414798 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.415146 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.415613 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.415942 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.416245 18094 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.230s (starting election) I0516 22:02:33.416901 18094 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Advancing to term 14 I0516 22:02:33.416929 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.417634 18100 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.417882 18066 leader_election.cc:393] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.418277 18346 consensus_peers.cc:456] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a -> Peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101): Closing peer: d2767dd0c676459aa9c2533260fc9d46 I0516 22:02:33.417197 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.418437 18346 raft_consensus.cc:2043] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Raft consensus is shut down! I0516 22:02:33.418644 18098 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.418691 18098 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.899s (starting election) I0516 22:02:33.418856 18165 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 13. I0516 22:02:33.419163 18066 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.420300 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.420936 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.420930 18230 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 12 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.420990 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 10 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.421015 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.421737 18167 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 9 FOLLOWER]: Advancing to term 10 I0516 22:02:33.421772 18230 raft_consensus.cc:2124] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for earlier term 12. Current term is 13. I0516 22:02:33.421775 18101 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.421919 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.422219 18102 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.422726 18347 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.773s (election complete) I0516 22:02:33.422960 18232 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 10. I0516 22:02:33.424109 18099 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.772s (starting election) I0516 22:02:33.424142 18066 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. I0516 22:02:33.424484 18099 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Advancing to term 14 I0516 22:02:33.424504 18167 raft_consensus.cc:2166] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 10 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.424499 18066 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 10 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.424692 18066 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. I0516 22:02:33.424916 18066 leader_election.cc:393] T 00efb34f943d4fa88ec6dcd181ee5c96 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 00efb34f943d4fa88ec6dcd181ee5c96 P b141e05cb0444865b490089e568edadc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 14 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.425509 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 10 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.425577 18066 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. I0516 22:02:33.425732 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. I0516 22:02:33.425719 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.425798 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.426108 18095 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.426215 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.426381 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 10 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.426470 18098 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 10 FOLLOWER]: Advancing to term 11 I0516 22:02:33.426798 18102 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.427145 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.426795 18099 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.427525 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.427532 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.427299 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 14 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.427811 18348 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.587s (election complete) I0516 22:02:33.427836 18346 ts_tablet_manager.cc:1369] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: Deleting tablet data with delete state TABLET_DATA_DELETED I0516 22:02:33.427827 18099 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.428042 18094 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.428277 18102 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.428452 18348 raft_consensus.cc:2459] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority I0516 22:02:33.428568 18323 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.138s (election complete) I0516 22:02:33.428565 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.428619 18289 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.582s (election complete) I0516 22:02:33.428859 18094 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.429256 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 14 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.429811 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.431383 18346 ts_tablet_manager.cc:1382] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1 I0516 22:02:33.431763 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 11 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.431816 18161 raft_consensus.cc:2166] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 13 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.431977 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.432035 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) @ 0x7ff0a857b64c google::LogMessage::SendToLog() at ??:0 I0516 22:02:33.432096 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. I0516 22:02:33.432215 18347 raft_consensus.cc:2474] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Leader election decision vote started in defunct term 8: won I0516 22:02:33.432340 18353 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.193s (election complete) I0516 22:02:33.432389 18353 raft_consensus.cc:2474] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Leader election decision vote started in defunct term 9: won I0516 22:02:33.432757 18167 raft_consensus.cc:2194] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 14 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.432848 18066 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 9 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.433122 18349 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.834s (election complete) I0516 22:02:33.433179 18349 raft_consensus.cc:2459] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority I0516 22:02:33.433166 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.433277 18098 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.433542 18348 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.901s (election complete) I0516 22:02:33.433631 18323 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won I0516 22:02:33.433770 18289 raft_consensus.cc:2474] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won I0516 22:02:33.433796 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. I0516 22:02:33.433799 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.433989 18094 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.434062 18066 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.434168 18165 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Advancing to term 14 I0516 22:02:33.434233 18165 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.206s (vote granted) I0516 22:02:33.434445 18066 leader_election.cc:393] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 11 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.434551 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 14 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.434618 18066 leader_election.cc:393] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 12 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.434727 18066 leader_election.cc:270] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. I0516 22:02:33.434732 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.434967 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.435475 18232 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 14 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.435586 18232 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 12 FOLLOWER]: Advancing to term 14 I0516 22:02:33.435822 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.436285 18093 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.436436 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.436553 18097 raft_consensus.cc:435] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.436553 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.436705 18097 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.379s (starting election) I0516 22:02:33.436763 18097 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Advancing to term 15 I0516 22:02:33.437263 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.437536 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.436952 18346 log.cc:981] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: Deleting WAL directory at /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-0-root/wals/fde57a2e13af4bcc9077306cd4109c3e I0516 22:02:33.438550 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 12 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.438714 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.438860 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.439033 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.439597 18351 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.533s (election complete) I0516 22:02:33.438489 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.439663 18351 raft_consensus.cc:2459] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) with higher term. Message: Service unavailable: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 11 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.439684 18348 raft_consensus.cc:2474] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Leader election decision vote started in defunct term 8: won I0516 22:02:33.439844 18095 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.439908 18346 ts_tablet_manager.cc:1402] T fde57a2e13af4bcc9077306cd4109c3e P d7e4c153959b4c86b9dcb5a3441a879a: Deleting consensus metadata I0516 22:02:33.439921 18289 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.140s (election complete) I0516 22:02:33.440471 18098 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.440470 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.440779 18098 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.440690 18097 raft_consensus.cc:457] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.440922 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.440969 18097 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.440992 18323 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.419s (election complete) I0516 22:02:33.441112 18323 raft_consensus.cc:2459] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority I0516 22:02:33.441325 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 13 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.441357 18230 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 14 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.441553 18230 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 13 FOLLOWER]: Advancing to term 14 I0516 22:02:33.441560 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.441871 18230 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.641s (vote granted) I0516 22:02:33.442250 18099 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.442376 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.442520 18095 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.727s (starting election) I0516 22:02:33.442499 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.442579 18095 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Advancing to term 15 I0516 22:02:33.442613 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.443024 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 14 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.443213 18289 raft_consensus.cc:2459] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority I0516 22:02:33.448828 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 11 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.448928 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.449290 18165 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 14. I0516 22:02:33.449514 18097 leader_election.cc:243] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.449733 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.449728 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 15 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.449800 18161 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 14 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.450074 18165 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 14 FOLLOWER]: Advancing to term 15 I0516 22:02:33.450069 18235 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 13 FOLLOWER]: Advancing to term 14 I0516 22:02:33.450201 18161 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Advancing to term 14 I0516 22:02:33.450263 18161 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.622s (vote granted) I0516 22:02:33.450642 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.450922 18165 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.648s (vote granted) I0516 22:02:33.451275 18066 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. I0516 22:02:33.451272 18093 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.451359 18083 tablet_service.cc:801] Processing DeleteTablet for tablet f970f063780d4349888d8fd439beb0a0 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.451586 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.452011 18289 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.548s (election complete) I0516 22:02:33.452018 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.452899 18289 raft_consensus.cc:2459] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority I0516 22:02:33.452600 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.452939 18167 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 10 FOLLOWER]: Advancing to term 11 I0516 22:02:33.452936 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.453680 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 13 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.453701 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.453825 18235 raft_consensus.cc:2166] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 14 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.454250 18228 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 15 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.454984 18232 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 14 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.454977 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.455276 18063 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.455368 18063 leader_election.cc:270] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. I0516 22:02:33.455492 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.455731 18230 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 14. I0516 22:02:33.455956 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.456033 18289 raft_consensus.cc:2704] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 7.331s (election complete) I0516 22:02:33.456285 18289 raft_consensus.cc:2474] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won I0516 22:02:33.455953 18095 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.457032 18167 raft_consensus.cc:2166] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 11 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.456989 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.457036 18100 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.457088 18100 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.795s (starting election) I0516 22:02:33.457113 18101 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.456718 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.457540 18100 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 11 FOLLOWER]: Advancing to term 12 I0516 22:02:33.457795 18095 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.457810 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 11 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.458065 18095 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.458606 18228 raft_consensus.cc:2756] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 14 FOLLOWER]: Advancing to term 15 I0516 22:02:33.458621 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.458457 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 11 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.459807 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.460357 18228 raft_consensus.cc:2166] T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 15 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.460520 18235 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 10 FOLLOWER]: Advancing to term 11 I0516 22:02:33.461014 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.461182 18161 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 14. I0516 22:02:33.461186 18165 raft_consensus.cc:2219] T f970f063780d4349888d8fd439beb0a0 P d2767dd0c676459aa9c2533260fc9d46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 15. I0516 22:02:33.461454 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.461572 18346 tablet_replica.cc:261] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: stopping tablet replica I0516 22:02:33.461575 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.461712 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.461899 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op CompactRowSetsOp(f970f063780d4349888d8fd439beb0a0) I0516 22:02:33.461906 18101 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.877s (starting election) I0516 22:02:33.461978 18101 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Advancing to term 15 I0516 22:02:33.461912 18100 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.462033 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.463182 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.463256 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.463333 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MinorDeltaCompactionOp(f970f063780d4349888d8fd439beb0a0) I0516 22:02:33.463409 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MajorDeltaCompactionOp(f970f063780d4349888d8fd439beb0a0) I0516 22:02:33.463508 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op UndoDeltaBlockGCOp(f970f063780d4349888d8fd439beb0a0) I0516 22:02:33.463563 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushMRSOp(f970f063780d4349888d8fd439beb0a0) I0516 22:02:33.463752 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.464025 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushDeltaMemStoresOp(f970f063780d4349888d8fd439beb0a0) I0516 22:02:33.464270 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.464321 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op LogGCOp(f970f063780d4349888d8fd439beb0a0) I0516 22:02:33.464131 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.464470 18235 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.210s (vote granted) I0516 22:02:33.464475 18099 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.464560 18099 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 6.618s (starting election) I0516 22:02:33.464545 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 @ 0x7ff0a8579189 google::LogMessage::Flush() at ??:0 I0516 22:02:33.466200 18235 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 11. I0516 22:02:33.466456 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. I0516 22:02:33.466464 18099 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Advancing to term 16 I0516 22:02:33.466681 18063 leader_election.cc:379] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.466902 18063 leader_election.cc:270] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. I0516 22:02:33.467231 18100 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.467372 18100 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.467566 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.467818 18101 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.468080 18101 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.468348 18289 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.169s (election complete) I0516 22:02:33.468380 18161 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 12 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.468186 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.468904 18346 raft_consensus.cc:2016] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Raft consensus shutting down. I0516 22:02:33.468945 18101 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.469310 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 15 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.469331 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 15 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.469897 18167 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Advancing to term 15 I0516 22:02:33.469898 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.470683 18323 raft_consensus.cc:2428] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Received election callback for term 15 while not running: Illegal state: RaftConsensus is not running: State = Stopping I0516 22:02:33.469424 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.470712 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.470840 18346 raft_consensus.cc:2043] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Raft consensus is shut down! I0516 22:02:33.470162 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.471102 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.471123 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.471645 18096 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.471772 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.472156 18066 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.472151 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.472229 18066 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. I0516 22:02:33.472317 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.472839 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.472748 18099 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.473232 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 15 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.473387 18235 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 14 FOLLOWER]: Advancing to term 15 I0516 22:02:33.473534 18235 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.769s (vote granted) I0516 22:02:33.473415 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.473950 18066 leader_election.cc:393] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 13 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.474035 18230 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 15 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.474046 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.474138 18230 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 14 FOLLOWER]: Advancing to term 15 I0516 22:02:33.474263 18346 ts_tablet_manager.cc:1369] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting tablet data with delete state TABLET_DATA_DELETED I0516 22:02:33.475131 18167 raft_consensus.cc:2166] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 15 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. W0516 22:02:33.475386 18066 leader_election.cc:363] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) with higher term. Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for earlier term 12. Current term is 13. I0516 22:02:33.475708 18161 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 11 FOLLOWER]: Advancing to term 12 I0516 22:02:33.476092 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 15 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.476115 18228 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 12 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.476482 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.476675 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.476686 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.477082 18228 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 11 FOLLOWER]: Advancing to term 12 I0516 22:02:33.477108 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.477371 18096 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.477391 18228 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 2.194s (vote granted) I0516 22:02:33.478770 18323 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.180s (election complete) I0516 22:02:33.478912 18323 raft_consensus.cc:2474] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 16 FOLLOWER]: Leader election decision vote started in defunct term 13: won I0516 22:02:33.479529 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.480087 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.480419 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.480664 18099 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.480679 18097 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.480738 18097 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.783s (starting election) I0516 22:02:33.480960 18097 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 12 FOLLOWER]: Advancing to term 13 I0516 22:02:33.481333 18099 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.481290 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 16 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.481343 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.481606 18167 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 15 FOLLOWER]: Advancing to term 16 I0516 22:02:33.481716 18228 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 12. I0516 22:02:33.483191 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.483781 18235 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 15. I0516 22:02:33.484616 18097 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.485172 18161 raft_consensus.cc:2166] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 12 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.485874 18167 raft_consensus.cc:2166] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 16 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.485993 18165 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 14 FOLLOWER]: Advancing to term 15 I0516 22:02:33.486059 18165 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.727s (vote granted) I0516 22:02:33.483661 18346 ts_tablet_manager.cc:1382] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0 I0516 22:02:33.486591 18230 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 15 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.486615 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.487042 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.487113 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.487134 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.487396 18094 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.487592 18289 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won I0516 22:02:33.487787 18098 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.487843 18098 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 4.319s (starting election) I0516 22:02:33.487943 18098 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Advancing to term 16 I0516 22:02:33.487960 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.488452 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.488919 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.489364 18098 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.489511 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.489578 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.489797 18165 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 15. I0516 22:02:33.489819 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.490007 18097 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.490123 18097 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.490226 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.490306 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 12 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.490470 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.490540 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 16 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.490674 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.490734 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.490779 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. I0516 22:02:33.490854 18346 log.cc:981] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting WAL directory at /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-0-root/wals/f970f063780d4349888d8fd439beb0a0 I0516 22:02:33.490885 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.490950 18289 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 4.474s (election complete) I0516 22:02:33.491055 18102 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.491123 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.491298 18102 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.930s (starting election) I0516 22:02:33.491297 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.491334 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 13 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.491564 18346 ts_tablet_manager.cc:1402] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting consensus metadata I0516 22:02:33.492081 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.492103 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.492179 18099 raft_consensus.cc:435] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 16 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.492355 18066 leader_election.cc:366] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term I0516 22:02:33.492703 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.492914 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. I0516 22:02:33.493039 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.493268 18066 leader_election.cc:393] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 14 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.493616 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.493614 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.493806 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.493893 18094 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.493876 18230 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 16 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.494352 18083 tablet_service.cc:801] Processing DeleteTablet for tablet 7966cd4464434af09b1b861e14d66bf9 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.494380 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 13 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.494493 18099 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 7.154s (starting election) I0516 22:02:33.494596 18235 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 12 FOLLOWER]: Advancing to term 13 I0516 22:02:33.494603 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.494797 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.495007 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.495012 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.495110 18096 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.495136 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.495239 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.495406 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 14 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.495599 18066 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.495678 18066 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. I0516 22:02:33.495790 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.495879 18289 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won I0516 22:02:33.495911 18066 leader_election.cc:393] T f970f063780d4349888d8fd439beb0a0 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T f970f063780d4349888d8fd439beb0a0 P b141e05cb0444865b490089e568edadc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 15 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.496062 18099 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 16 FOLLOWER]: Advancing to term 17 I0516 22:02:33.496078 18102 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 13 FOLLOWER]: Advancing to term 14 I0516 22:02:33.497303 18165 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 12 FOLLOWER]: Advancing to term 13 I0516 22:02:33.497637 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.497730 18096 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.497998 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.497995 18102 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.498248 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 @ 0x7ff0a857bfdf google::LogMessageFatal::~LogMessageFatal() at ??:0 I0516 22:02:33.498360 18235 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.539s (vote granted) I0516 22:02:33.498498 18230 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 15 FOLLOWER]: Advancing to term 16 I0516 22:02:33.498561 18230 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.571s (vote granted) I0516 22:02:33.498555 18348 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.548s (election complete) I0516 22:02:33.498626 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.498805 18102 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.498988 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.499223 18102 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.499464 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 14 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.499843 18346 tablet_replica.cc:261] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: stopping tablet replica I0516 22:02:33.499838 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.499989 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op CompactRowSetsOp(7966cd4464434af09b1b861e14d66bf9) I0516 22:02:33.500265 18098 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.500819 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.501186 18348 raft_consensus.cc:2474] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Leader election decision vote started in defunct term 10: won I0516 22:02:33.501596 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.502223 18098 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.502619 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.503214 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MinorDeltaCompactionOp(7966cd4464434af09b1b861e14d66bf9) I0516 22:02:33.503175 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.503301 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MajorDeltaCompactionOp(7966cd4464434af09b1b861e14d66bf9) I0516 22:02:33.503329 18096 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.503597 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.503815 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op UndoDeltaBlockGCOp(7966cd4464434af09b1b861e14d66bf9) I0516 22:02:33.503896 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushMRSOp(7966cd4464434af09b1b861e14d66bf9) I0516 22:02:33.504334 18165 raft_consensus.cc:2166] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 13 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.504699 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.504730 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.505748 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.505755 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.505733 18161 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 16 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.506242 18167 raft_consensus.cc:2194] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 14 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.506245 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushDeltaMemStoresOp(7966cd4464434af09b1b861e14d66bf9) I0516 22:02:33.506497 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op LogGCOp(7966cd4464434af09b1b861e14d66bf9) I0516 22:02:33.506654 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.506789 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.506947 18235 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 13. I0516 22:02:33.507073 18161 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 15 FOLLOWER]: Advancing to term 16 I0516 22:02:33.507161 18096 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.141s (starting election) I0516 22:02:33.507242 18096 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 14 FOLLOWER]: Advancing to term 15 I0516 22:02:33.507408 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.507691 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.507890 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.507957 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. I0516 22:02:33.508082 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.508723 18230 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 16. I0516 22:02:33.509032 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.509186 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 13 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.509387 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 14 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.509640 18097 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.509758 18094 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 16 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.509775 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.509822 18094 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.665s (starting election) I0516 22:02:33.509986 18094 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 16 FOLLOWER]: Advancing to term 17 I0516 22:02:33.510007 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.510267 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.510371 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.510722 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.510728 18099 raft_consensus.cc:457] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.511059 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.511435 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.511570 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.511598 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.511500 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. I0516 22:02:33.511888 18096 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.511999 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.512147 18096 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.512468 18096 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.512805 18348 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.264s (election complete) I0516 22:02:33.512940 18348 raft_consensus.cc:2474] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Leader election decision vote started in defunct term 11: won I0516 22:02:33.512816 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 15 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.513231 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.513365 18099 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.513590 18167 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 13 FOLLOWER]: Advancing to term 15 I0516 22:02:33.513607 18351 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.304s (election complete) I0516 22:02:33.513684 18351 raft_consensus.cc:2474] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Leader election decision vote started in defunct term 12: won I0516 22:02:33.513582 18094 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.513988 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.514549 18230 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 14 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.514552 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 17 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.514670 18066 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.514694 18165 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 16 FOLLOWER]: Advancing to term 17 I0516 22:02:33.514750 18066 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. I0516 22:02:33.514757 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.515604 18161 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.737s (vote granted) I0516 22:02:33.516348 18098 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.516664 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.516952 18230 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 13 FOLLOWER]: Advancing to term 14 I0516 22:02:33.517041 18230 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.591s (vote granted) I0516 22:02:33.517009 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.517310 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.517478 18102 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.517670 18167 raft_consensus.cc:2166] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 15 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.517797 18161 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 16. I0516 22:02:33.517921 18346 raft_consensus.cc:2016] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 17 FOLLOWER]: Raft consensus shutting down. I0516 22:02:33.517930 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.518008 18289 raft_consensus.cc:2428] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 17 FOLLOWER]: Received election callback for term 14 while not running: Illegal state: RaftConsensus is not running: State = Stopping I0516 22:02:33.518097 18346 raft_consensus.cc:2043] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 17 FOLLOWER]: Raft consensus is shut down! I0516 22:02:33.517763 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 16 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.518287 18235 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 15 FOLLOWER]: Advancing to term 16 I0516 22:02:33.518308 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.518362 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. I0516 22:02:33.518712 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.518934 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.518967 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.519348 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 15 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.519356 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.519737 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.521154 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.521181 18323 raft_consensus.cc:2428] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 17 FOLLOWER]: Received election callback for term 12 while not running: Illegal state: RaftConsensus is not running: State = Stopped I0516 22:02:33.521143 18228 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 15 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.521184 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.521543 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. I0516 22:02:33.521545 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 15 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.521688 18289 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.359s (election complete) I0516 22:02:33.521697 18323 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.054s (election complete) I0516 22:02:33.521776 18289 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won I0516 22:02:33.521818 18323 raft_consensus.cc:2474] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Leader election decision vote started in defunct term 13: won I0516 22:02:33.521822 18066 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.521816 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.521981 18066 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. I0516 22:02:33.521528 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 W0516 22:02:33.522099 18066 raft_consensus.cc:2415] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Unable to run election callback: Service unavailable: Thread pool token was shut down I0516 22:02:33.522104 18097 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.522187 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.522275 18093 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.522331 18093 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.707s (starting election) I0516 22:02:33.522392 18093 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 15 FOLLOWER]: Advancing to term 16 I0516 22:02:33.522389 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.522532 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.522977 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.523386 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.523727 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.523815 18096 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.523814 18093 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.524196 18094 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.524173 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.524314 18093 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.524719 18094 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.524718 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.524790 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.524940 18235 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 16 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.525234 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 16 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.525348 18099 leader_election.cc:243] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.525471 18165 raft_consensus.cc:2166] T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 17 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.525547 18161 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 17 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.525804 18351 raft_consensus.cc:2428] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [term 17 FOLLOWER]: Received election callback for term 15 while not running: Illegal state: RaftConsensus is not running: State = Stopped I0516 22:02:33.525782 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 17 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.526152 18063 leader_election.cc:393] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T 7966cd4464434af09b1b861e14d66bf9 P d2767dd0c676459aa9c2533260fc9d46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 17 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.526178 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.526742 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.526736 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.526958 18161 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 16 FOLLOWER]: Advancing to term 17 I0516 22:02:33.526964 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 16 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.526998 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.527328 18161 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.157s (vote granted) I0516 22:02:33.527449 18232 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 17 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.527606 18232 raft_consensus.cc:2756] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 16 FOLLOWER]: Advancing to term 17 I0516 22:02:33.527676 18232 raft_consensus.cc:2704] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.730s (vote granted) I0516 22:02:33.527694 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.527834 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.527024 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.529072 18230 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 14. I0516 22:02:33.529078 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.529517 18228 raft_consensus.cc:2194] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 15 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.529531 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.529863 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.530119 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.530117 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.530163 18346 ts_tablet_manager.cc:1369] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting tablet data with delete state TABLET_DATA_DELETED I0516 22:02:33.530234 18161 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 17. I0516 22:02:33.530282 18093 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.530432 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. I0516 22:02:33.530720 18351 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.858s (election complete) I0516 22:02:33.530721 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.530969 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. I0516 22:02:33.530977 18351 raft_consensus.cc:2474] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 16 FOLLOWER]: Leader election decision vote started in defunct term 14: won I0516 22:02:33.531070 18066 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 15 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.531357 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. I0516 22:02:33.531352 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.531545 18235 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 16 FOLLOWER]: Advancing to term 17 I0516 22:02:33.531697 18232 raft_consensus.cc:2219] T 7966cd4464434af09b1b861e14d66bf9 P b141e05cb0444865b490089e568edadc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 17. I0516 22:02:33.531982 18101 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 17 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.532037 18101 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.105s (starting election) I0516 22:02:33.531988 18228 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 16 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.532292 18323 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.178s (election complete) I0516 22:02:33.532397 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.532569 18101 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 17 FOLLOWER]: Advancing to term 18 I0516 22:02:33.532572 18228 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 14 FOLLOWER]: Advancing to term 16 I0516 22:02:33.532668 18066 leader_election.cc:379] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.534281 18167 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 15 FOLLOWER]: Advancing to term 16 I0516 22:02:33.534656 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.534930 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.534652 18101 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.535413 18323 raft_consensus.cc:2459] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority I0516 22:02:33.535475 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.535511 18099 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.535631 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.535650 18228 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.599s (vote granted) I0516 22:02:33.536335 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.536440 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.536486 18351 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.706s (election complete) I0516 22:02:33.536586 18101 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 18 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.536849 18101 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 18 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.536852 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.537133 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.537370 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.537379 18161 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 18 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.537508 18161 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 17 FOLLOWER]: Advancing to term 18 I0516 22:02:33.537626 18161 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.748s (vote granted) I0516 22:02:33.538002 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.539172 18066 leader_election.cc:270] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. I0516 22:02:33.539182 18351 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won I0516 22:02:33.538974 18228 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 16. I0516 22:02:33.539424 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.539535 18093 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 16 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.539789 18093 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 4.609s (starting election) I0516 22:02:33.539854 18093 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 16 FOLLOWER]: Advancing to term 17 I0516 22:02:33.540293 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.540765 18346 ts_tablet_manager.cc:1382] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0 I0516 22:02:33.540928 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.542845 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 W0516 22:02:33.543514 18066 raft_consensus.cc:2415] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Unable to run election callback: Service unavailable: Thread pool token was shut down I0516 22:02:33.543856 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.543854 18102 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.544124 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.544134 18161 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 18. I0516 22:02:33.544220 18101 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 18 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.544322 18101 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.411s (starting election) I0516 22:02:33.544369 18101 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 18 FOLLOWER]: Advancing to term 19 I0516 22:02:33.544577 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.544764 18235 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 17 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.545025 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.544634 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.545310 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 18 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.545375 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. I0516 22:02:33.545593 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.546025 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.546823 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.546811 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.547010 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.547062 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. I0516 22:02:33.546896 18093 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.547507 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 18 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.547616 18098 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.547679 18235 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 17 FOLLOWER]: Advancing to term 18 I0516 22:02:33.547693 18323 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.237s (election complete) I0516 22:02:33.547752 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.547683 18093 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.547996 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.548485 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.548713 18346 log.cc:981] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting WAL directory at /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-0-root/wals/7966cd4464434af09b1b861e14d66bf9 I0516 22:02:33.548755 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.548945 18095 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.549057 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.549458 18167 raft_consensus.cc:2166] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 16 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.549515 18346 ts_tablet_manager.cc:1402] T 7966cd4464434af09b1b861e14d66bf9 P d7e4c153959b4c86b9dcb5a3441a879a: Deleting consensus metadata I0516 22:02:33.549523 18161 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 17 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.549659 18161 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 16 FOLLOWER]: Advancing to term 17 I0516 22:02:33.549845 18323 raft_consensus.cc:2474] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won I0516 22:02:33.549923 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.549556 18101 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.550283 18351 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 2.680s (election complete) I0516 22:02:33.550277 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 17 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.550510 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 16 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 16 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.550616 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.550820 18101 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 19 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.550979 18093 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.550101 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.551455 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.551635 18351 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won I0516 22:02:33.552084 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.552089 18228 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 17 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.552225 18228 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 16 FOLLOWER]: Advancing to term 17 I0516 22:02:33.552223 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.552270 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.552523 18228 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.896s (vote granted) I0516 22:02:33.552695 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.552809 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.553020 18232 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 19 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.553421 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.554137 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.554491 18101 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 19 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.554520 18228 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 17. I0516 22:02:33.555045 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.555043 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.555191 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.555339 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. I0516 22:02:33.555254 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.555647 18095 raft_consensus.cc:435] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 17 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.555852 18099 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.555869 18083 tablet_service.cc:801] Processing DeleteTablet for tablet f44edd9cb161433f9ae53e8d2e60e43e with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.556011 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 19 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.556423 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.556427 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.556452 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.556752 18167 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 18 FOLLOWER]: Advancing to term 19 I0516 22:02:33.556759 18095 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 4.610s (starting election) I0516 22:02:33.557065 18095 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 17 FOLLOWER]: Advancing to term 18 I0516 22:02:33.557478 18235 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 18 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.557581 18232 raft_consensus.cc:2194] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 19 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.557925 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.558007 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 19 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Service unavailable: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 19 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.558226 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.558320 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 @ 0x7ff0b0a7c5d6 kudu::consensus::ShouldEvictReplica() at ??:0 I0516 22:02:33.558647 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.558836 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.558876 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 18 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 18 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.559095 18167 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.683s (vote granted) I0516 22:02:33.559098 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.559305 18093 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 19 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.559341 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.559377 18093 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.919s (starting election) I0516 22:02:33.559437 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.559598 18100 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.559682 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.559667 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.559816 18095 raft_consensus.cc:457] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } I0516 22:02:33.560099 18095 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 18 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.560201 18095 leader_election.cc:243] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 18 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.560354 18351 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 4.771s (election complete) I0516 22:02:33.560412 18351 raft_consensus.cc:2474] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won I0516 22:02:33.560624 18346 tablet_replica.cc:261] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: stopping tablet replica I0516 22:02:33.560724 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op CompactRowSetsOp(f44edd9cb161433f9ae53e8d2e60e43e) I0516 22:02:33.560775 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MinorDeltaCompactionOp(f44edd9cb161433f9ae53e8d2e60e43e) I0516 22:02:33.560833 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MajorDeltaCompactionOp(f44edd9cb161433f9ae53e8d2e60e43e) I0516 22:02:33.560791 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 18 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.560873 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op UndoDeltaBlockGCOp(f44edd9cb161433f9ae53e8d2e60e43e) I0516 22:02:33.560919 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushMRSOp(f44edd9cb161433f9ae53e8d2e60e43e) I0516 22:02:33.560957 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushDeltaMemStoresOp(f44edd9cb161433f9ae53e8d2e60e43e) I0516 22:02:33.560986 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op LogGCOp(f44edd9cb161433f9ae53e8d2e60e43e) I0516 22:02:33.561023 18346 raft_consensus.cc:2016] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 18 FOLLOWER]: Raft consensus shutting down. I0516 22:02:33.561102 18346 raft_consensus.cc:2043] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [term 18 FOLLOWER]: Raft consensus is shut down! I0516 22:02:33.561575 18346 ts_tablet_manager.cc:1369] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Deleting tablet data with delete state TABLET_DATA_DELETED I0516 22:02:33.562014 18093 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 19 FOLLOWER]: Advancing to term 20 I0516 22:02:33.562310 18161 raft_consensus.cc:2166] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 17 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.562439 18165 raft_consensus.cc:2194] T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 18 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.562640 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 17 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Invalid argument: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 17 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.562896 18063 leader_election.cc:393] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 18 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T f44edd9cb161433f9ae53e8d2e60e43e P d2767dd0c676459aa9c2533260fc9d46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 18 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.563591 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 18 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.563735 18235 raft_consensus.cc:2756] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 17 FOLLOWER]: Advancing to term 18 I0516 22:02:33.563791 18235 raft_consensus.cc:2704] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc: Snoozing failure detection for 1.602s (vote granted) I0516 22:02:33.564168 18093 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.564410 18167 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 19. I0516 22:02:33.564518 18093 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 20 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.564621 18093 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 20 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.565454 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 19 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.565680 18232 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 20 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.566042 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.566308 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. I0516 22:02:33.565722 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.566561 18232 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 18 FOLLOWER]: Advancing to term 20 I0516 22:02:33.566612 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.566913 18351 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.664s (election complete) I0516 22:02:33.566918 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.567034 18351 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won I0516 22:02:33.567097 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.567268 18099 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.567375 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.567665 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.567814 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.568135 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.568230 18099 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 20 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.568327 18099 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 4.289s (starting election) I0516 22:02:33.568387 18099 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 20 FOLLOWER]: Advancing to term 21 I0516 22:02:33.568557 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.568902 18232 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 20 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.568904 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.569557 18346 ts_tablet_manager.cc:1382] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0 I0516 22:02:33.569561 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.570098 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.570220 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.570490 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 20 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 20 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.570603 18235 raft_consensus.cc:2219] T f44edd9cb161433f9ae53e8d2e60e43e P b141e05cb0444865b490089e568edadc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 18. I0516 22:02:33.570658 18167 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 20 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.570868 18167 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 19 FOLLOWER]: Advancing to term 20 I0516 22:02:33.571238 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.571707 18096 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.571830 18102 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.571877 18101 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.572031 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.572180 18093 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.572271 18346 log.cc:981] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Deleting WAL directory at /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-0-root/wals/f44edd9cb161433f9ae53e8d2e60e43e I0516 22:02:33.572289 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.572232 18099 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.572551 18099 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 21 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.572553 18346 ts_tablet_manager.cc:1402] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Deleting consensus metadata I0516 22:02:33.572762 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.572888 18099 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 21 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.572927 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.573094 18167 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.946s (vote granted) I0516 22:02:33.573387 18066 leader_election.cc:379] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 18 election: Vote granted by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.573392 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.573391 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 21 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.573451 18066 leader_election.cc:270] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. I0516 22:02:33.573580 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.573599 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 W0516 22:02:33.573643 18066 raft_consensus.cc:2415] T f44edd9cb161433f9ae53e8d2e60e43e P d7e4c153959b4c86b9dcb5a3441a879a: Unable to run election callback: Service unavailable: Thread pool token was shut down I0516 22:02:33.574280 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.574426 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 21 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.574571 18235 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 20 FOLLOWER]: Advancing to term 21 I0516 22:02:33.574668 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.575088 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.575235 18097 raft_consensus.cc:418] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.575289 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.575652 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.575883 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.575991 18094 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 21 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.576053 18167 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 20. I0516 22:02:33.576099 18094 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.503s (starting election) I0516 22:02:33.576162 18094 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 21 FOLLOWER]: Advancing to term 22 I0516 22:02:33.576383 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 20 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.576619 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. I0516 22:02:33.576977 18165 raft_consensus.cc:2194] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 21 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.577343 18063 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 21 election: Vote denied by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101). Message: Service unavailable: T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 21 because replica is already servicing an update from a current leader or another vote. I0516 22:02:33.577569 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.577801 18235 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 21 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.578008 18083 tablet_service.cc:801] Processing DeleteTablet for tablet d744b1d6ab5c4844bd636ab76a6c3bee with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.578061 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 21 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 21 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.578145 18066 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. I0516 22:02:33.578281 18346 tablet_replica.cc:261] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: stopping tablet replica I0516 22:02:33.578127 18094 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.578366 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op CompactRowSetsOp(d744b1d6ab5c4844bd636ab76a6c3bee) I0516 22:02:33.578445 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MinorDeltaCompactionOp(d744b1d6ab5c4844bd636ab76a6c3bee) I0516 22:02:33.578488 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MajorDeltaCompactionOp(d744b1d6ab5c4844bd636ab76a6c3bee) I0516 22:02:33.578541 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op UndoDeltaBlockGCOp(d744b1d6ab5c4844bd636ab76a6c3bee) I0516 22:02:33.578631 18094 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 22 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.578626 18351 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 4.008s (election complete) I0516 22:02:33.578848 18094 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 22 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.578853 18351 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 22 FOLLOWER]: Leader election decision vote started in defunct term 20: won I0516 22:02:33.578853 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.578974 18323 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 1.801s (election complete) I0516 22:02:33.579077 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushMRSOp(d744b1d6ab5c4844bd636ab76a6c3bee) I0516 22:02:33.579124 18323 raft_consensus.cc:2459] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority I0516 22:02:33.579398 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 22 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.579455 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.579433 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 22 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.579720 18165 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 20 FOLLOWER]: Advancing to term 22 I0516 22:02:33.579699 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.579741 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.579779 18165 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 2.044s (vote granted) I0516 22:02:33.580157 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushDeltaMemStoresOp(d744b1d6ab5c4844bd636ab76a6c3bee) I0516 22:02:33.580296 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.580054 18235 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 21 FOLLOWER]: Advancing to term 22 I0516 22:02:33.581131 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op LogGCOp(d744b1d6ab5c4844bd636ab76a6c3bee) I0516 22:02:33.581568 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.581763 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.581959 18165 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 22. I0516 22:02:33.581964 18346 raft_consensus.cc:2016] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 LEADER]: Raft consensus shutting down. I0516 22:02:33.582072 18346 consensus_peers.cc:456] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a -> Peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899): Closing peer: b141e05cb0444865b490089e568edadc I0516 22:02:33.582217 18346 consensus_peers.cc:456] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a -> Peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101): Closing peer: d2767dd0c676459aa9c2533260fc9d46 I0516 22:02:33.582455 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.582706 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 22 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.582768 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. I0516 22:02:33.582744 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.582892 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.583154 18094 raft_consensus.cc:435] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 22 FOLLOWER]: Starting forced leader election (received explicit request) I0516 22:02:33.583132 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.583231 18094 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 5.771s (starting election) I0516 22:02:33.583334 18094 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 22 FOLLOWER]: Advancing to term 23 I0516 22:02:33.583798 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.583883 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.583812 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.584005 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.584489 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.584830 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.585186 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.585247 18094 raft_consensus.cc:457] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } I0516 22:02:33.585492 18235 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 22 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.585554 18323 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 3.906s (election complete) I0516 22:02:33.585640 18323 raft_consensus.cc:2474] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 23 FOLLOWER]: Leader election decision vote started in defunct term 22: won I0516 22:02:33.585553 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.585858 18094 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 23 election: Requesting vote from peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899) I0516 22:02:33.585861 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 22 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 22 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.585956 18094 leader_election.cc:243] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 23 election: Requesting vote from peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.586355 18165 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 23 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2767dd0c676459aa9c2533260fc9d46" I0516 22:02:33.586472 18346 raft_consensus.cc:2043] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a [term 1 FOLLOWER]: Raft consensus is shut down! I0516 22:02:33.586496 18165 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 22 FOLLOWER]: Advancing to term 23 I0516 22:02:33.586678 18165 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46: Snoozing failure detection for 1.755s (vote granted) I0516 22:02:33.586788 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.587182 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.588071 18165 raft_consensus.cc:2219] T 50f4658409f4467d91579fefb4bbc4af P d2767dd0c676459aa9c2533260fc9d46 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e4c153959b4c86b9dcb5a3441a879a in term 23. I0516 22:02:33.588095 18235 tablet_service.cc:998] Received RequestConsensusVote() RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" candidate_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" candidate_term: 23 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b141e05cb0444865b490089e568edadc" I0516 22:02:33.588239 18235 raft_consensus.cc:2756] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 22 FOLLOWER]: Advancing to term 23 I0516 22:02:33.588344 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.588755 18063 leader_election.cc:379] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 23 election: Vote granted by peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101) I0516 22:02:33.588748 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.588819 18063 leader_election.cc:270] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. I0516 22:02:33.589154 18323 raft_consensus.cc:2704] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Snoozing failure detection for 4.168s (election complete) I0516 22:02:33.589156 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.589541 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.589715 18323 raft_consensus.cc:2511] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 23 FOLLOWER]: Leader election won for term 23 I0516 22:02:33.589745 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.589967 18323 raft_consensus.cc:571] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 23 LEADER]: Becoming Leader. State: Replica: d7e4c153959b4c86b9dcb5a3441a879a, State: Running, Role: LEADER I0516 22:02:33.589964 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.590266 18323 consensus_queue.cc:204] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" member_type: VOTER last_known_addr { host: "127.17.88.1" port: 47831 } } peers { permanent_uuid: "b141e05cb0444865b490089e568edadc" member_type: VOTER last_known_addr { host: "127.17.88.3" port: 49899 } } peers { permanent_uuid: "d2767dd0c676459aa9c2533260fc9d46" member_type: VOTER last_known_addr { host: "127.17.88.2" port: 58101 } } @ 0x7ff0b66296b3 kudu::master::CatalogManager::ProcessTabletReport() at ??:0 I0516 22:02:33.590523 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.590855 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.591071 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.596834 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.596920 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.597591 18346 ts_tablet_manager.cc:1369] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: Deleting tablet data with delete state TABLET_DATA_DELETED I0516 22:02:33.597720 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.597990 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.598955 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.599247 18093 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.599256 18095 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.599613 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.599637 18097 raft_consensus.cc:418] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 23 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.599184 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.600193 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.600436 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.600811 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.601227 18235 raft_consensus.cc:2166] T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 23 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.601526 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.601696 18066 leader_election.cc:393] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [CANDIDATE]: Term 23 election: Vote denied by peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899). Message: Invalid argument: T 50f4658409f4467d91579fefb4bbc4af P b141e05cb0444865b490089e568edadc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d7e4c153959b4c86b9dcb5a3441a879a for term 23 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0516 22:02:33.601945 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.602041 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.602427 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.602649 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.602864 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.602986 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.603138 18097 raft_consensus.cc:418] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 23 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.603256 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.603266 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.604516 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.604647 18346 ts_tablet_manager.cc:1382] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1 I0516 22:02:33.604737 18346 log.cc:981] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: Deleting WAL directory at /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-0-root/wals/d744b1d6ab5c4844bd636ab76a6c3bee I0516 22:02:33.604831 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.605123 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.605352 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.605633 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.605787 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.606173 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.606397 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.606703 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.606850 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.606984 18097 raft_consensus.cc:418] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 23 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.607127 18346 ts_tablet_manager.cc:1402] T d744b1d6ab5c4844bd636ab76a6c3bee P d7e4c153959b4c86b9dcb5a3441a879a: Deleting consensus metadata I0516 22:02:33.607117 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.607491 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.607664 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.607976 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 @ 0x7ff0b673744b kudu::master::MasterServiceImpl::TSHeartbeat() at ??:0 I0516 22:02:33.608422 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.608774 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.608991 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.609086 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.609521 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.609719 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.609817 18097 raft_consensus.cc:418] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 23 LEADER]: Not starting forced leader election -- already a leader I0516 22:02:33.610016 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.610258 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.610579 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.610734 18083 tablet_service.cc:801] Processing DeleteTablet for tablet 50f4658409f4467d91579fefb4bbc4af with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.610865 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.610939 18346 tablet_replica.cc:261] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: stopping tablet replica I0516 22:02:33.611006 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op CompactRowSetsOp(50f4658409f4467d91579fefb4bbc4af) I0516 22:02:33.611074 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MinorDeltaCompactionOp(50f4658409f4467d91579fefb4bbc4af) I0516 22:02:33.611107 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op MajorDeltaCompactionOp(50f4658409f4467d91579fefb4bbc4af) I0516 22:02:33.611176 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op UndoDeltaBlockGCOp(50f4658409f4467d91579fefb4bbc4af) I0516 22:02:33.611238 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushMRSOp(50f4658409f4467d91579fefb4bbc4af) I0516 22:02:33.611286 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.611434 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op FlushDeltaMemStoresOp(50f4658409f4467d91579fefb4bbc4af) I0516 22:02:33.611469 18346 maintenance_manager.cc:237] P d7e4c153959b4c86b9dcb5a3441a879a: Unregistered op LogGCOp(50f4658409f4467d91579fefb4bbc4af) I0516 22:02:33.611507 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.611685 18346 raft_consensus.cc:2016] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 23 LEADER]: Raft consensus shutting down. I0516 22:02:33.611733 18346 consensus_peers.cc:456] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a -> Peer d2767dd0c676459aa9c2533260fc9d46 (127.17.88.2:58101): Closing peer: d2767dd0c676459aa9c2533260fc9d46 I0516 22:02:33.611919 18346 consensus_peers.cc:456] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a -> Peer b141e05cb0444865b490089e568edadc (127.17.88.3:49899): Closing peer: b141e05cb0444865b490089e568edadc I0516 22:02:33.611958 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.612052 18346 pending_rounds.cc:63] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Trying to abort 1 pending transactions. I0516 22:02:33.612092 18346 pending_rounds.cc:68] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Aborting transaction as it isn't in flight: id { term: 23 index: 1 } timestamp: 6252577397107204096 op_type: NO_OP noop_request { } I0516 22:02:33.612195 18346 raft_consensus.cc:2594] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 23 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0516 22:02:33.612267 18346 raft_consensus.cc:2043] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a [term 23 FOLLOWER]: Raft consensus is shut down! I0516 22:02:33.612386 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.612789 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.613186 18346 ts_tablet_manager.cc:1369] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Deleting tablet data with delete state TABLET_DATA_DELETED I0516 22:02:33.613431 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.613929 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.614226 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.614512 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.614703 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.615017 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.615283 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.615634 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.615860 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.616178 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 @ 0x7ff0b29bdd3a std::_Function_handler<>::_M_invoke() at ??:0 I0516 22:02:33.616470 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.616636 18346 ts_tablet_manager.cc:1382] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 23.1 I0516 22:02:33.616731 18346 log.cc:981] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Deleting WAL directory at /tmp/dist-test-tasksS1KRx/test-tmp/delete_tablet-itest.0.DeleteTabletITest.TestLeaderElectionDuringDeleteTablet.1526508151408653-17760/minicluster-data/ts-0-root/wals/50f4658409f4467d91579fefb4bbc4af I0516 22:02:33.617024 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.619689 18346 ts_tablet_manager.cc:1402] T 50f4658409f4467d91579fefb4bbc4af P d7e4c153959b4c86b9dcb5a3441a879a: Deleting consensus metadata I0516 22:02:33.619787 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.620316 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f970f063780d4349888d8fd439beb0a0" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.620549 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "807b2c351057419d846ab8586e3ed167" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.620645 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "ab7b2ac793a4455e9bbe98795c6a392f" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.620548 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "fde57a2e13af4bcc9077306cd4109c3e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.620977 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "d744b1d6ab5c4844bd636ab76a6c3bee" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.621446 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "7966cd4464434af09b1b861e14d66bf9" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.622035 18097 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "00efb34f943d4fa88ec6dcd181ee5c96" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.622262 18094 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "50f4658409f4467d91579fefb4bbc4af" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.622596 18100 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f2d85aa48a984f07a36195498f0f3754" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.622769 18099 tablet_service.cc:1113] Received Run Leader Election RPC: tablet_id: "f44edd9cb161433f9ae53e8d2e60e43e" dest_uuid: "d7e4c153959b4c86b9dcb5a3441a879a" from {username='slave'} at 127.0.0.1:45694 I0516 22:02:33.624136 17760 tablet_server.cc:144] TabletServer shutting down... @ 0x7ff0afbcfdcc std::function<>::operator()() at ??:0 @ 0x7ff0afbcea2e kudu::rpc::GeneratedServiceIf::Handle() at ??:0 @ 0x7ff0afbd2438 kudu::rpc::ServicePool::RunThread() at ??:0 @ 0x7ff0afbd7913 boost::_bi::bind_t<>::operator()() at ??:0 @ 0x7ff0afb32dbc boost::function0<>::operator()() at ??:0 @ 0x7ff0a9e224cb kudu::Thread::SuperviseThread() at ??:0 @ 0x7ff0abb1d184 start_thread at ??:0 @ 0x7ff0a6d27ffd clone at ??:0